00000001:02000400:2.0F:1789127095.751078:0:2955:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg640-server.virtnet: executing set_hostid 00000001:02000400:2.0:1789127109.898460:0:3177:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg640-server.virtnet: executing load_modules_local 00000001:01000000:3.0F:1789127111.554898:0:3238:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 535 MB/s 00000001:01000000:3.0:1789127111.806410:0:3238:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 681 MB/s 00000001:01000000:3.0:1789127112.055975:0:3238:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4799 MB/s 00000020:02000000:2.0:1789127112.742003:0:3269:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_135_g8edbab4 00000400:02000000:2.0:1789127114.070866:0:3284:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.206.140@tcp [8/256/0/180] 00008000:02000000:0.0F:1789127117.476234:0:3434:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1789127164.794168:0:5234:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg640-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1789127174.456334:0:5811:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789127174.456340:0:5811:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1789127174.456746:0:5811:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000001873f978 00000080:02000400:0.0:1789127174.457047:0:5811:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:0.0:1789127174.464905:0:5811:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:0.0:1789127174.464923:0:5811:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0F:1789127174.465084:0:5811:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000000157fcb9) 00000020:00000080:1.0:1789127174.465120:0:5811:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1789127174.498075:0:5811:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1789127174.499018:0:5811:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1789127174.538023:0:5811:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1789127174.538059:0:5811:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1789127174.538077:0:5811:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1789127174.538122:0:5811:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1789127174.538144:0:5811:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1789127174.539245:0:5811:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1789127174.539320:0:5811:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789127174.539334:0:5811:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xeeacf7c0243000c2 00000020:01000004:1.0:1789127174.539343:0:5811:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:1.0:1789127174.539349:0:5811:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1789127174.539354:0:5811:0:(tgt_mount.c:101:server_register_mount()) register mount 000000001873f978 from MGS 00000020:01000004:1.0:1789127174.539359:0:5811:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1789127174.539371:0:5811:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000021ba24f) 00000020:00000080:1.0:1789127174.539381:0:5811:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1789127174.539495:0:5811:0:(tgt_mount.c:153:server_get_mount()) get mount 000000001873f978 from MGS, refs=2 00080000:01000000:1.0:1789127174.539501:0:5811:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789127174.539505:0:5811:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xeeacf7c0243000d0 00000100:00100000:1.0:1789127174.540000:0:5811:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1789127174.540171:0:5811:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1789127174.540179:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1789127174.541334:0:5811:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1789127174.541345:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1789127174.543480:0:5811:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789127174.544163:0:5811:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1789127174.544170:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1789127174.546012:0:5811:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1789127174.546026:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1789127174.547005:0:5811:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1789127174.547105:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1789127174.548705:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127174.548727:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127174.548729:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127174.549398:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127174.549402:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127174.549404:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127174.550731:0:5811:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1789127174.552350:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1789127174.802437:0:5811:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2392 MB/s 00000001:01000000:2.0:1789127175.052083:0:5811:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2575 MB/s 00000001:01000000:0.0:1789127175.302326:0:5811:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 423 MB/s 00000001:01000000:2.0:1789127175.560972:0:5811:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 729 MB/s 00080000:10000000:3.0:1789127175.585914:0:5811:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:0.0:1789127175.604562:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1789127175.612087:0:5811:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1789127175.612118:0:5811:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789127175.612121:0:5811:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1789127175.613455:0:5821:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1789127175.613513:0:5811:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1789127175.613565:0:5811:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1789127175.614228:0:5811:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1789127175.614267:0:5811:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1789127175.614754:0:5811:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789127175.615590:0:5811:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1789127175.615599:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1789127175.619419:0:5811:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1789127175.619436:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1789127175.620752:0:5811:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1789127175.620764:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:0.0:1789127175.632686:0:5826:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:1.0:1789127175.632695:0:5811:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1789127175.632721:0:5811:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.140@tcp' 00000020:01000004:1.0:1789127175.632724:0:5811:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1789127175.633403:0:5811:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.140@tcp (typ=mgc) 00000020:00000080:1.0:1789127175.633420:0:5811:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.140@tcp (00000000e351a71c) 00000020:00000080:1.0:1789127175.633442:0:5811:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1789127175.633592:0:5811:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000039019b34@MGC192.168.206.140@tcp: add connection 192.168.206.140@tcp at head 00010000:00010000:1.0:1789127175.633896:0:5811:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.140@tcp-0 is initialized 00000040:01000000:1.0:1789127175.633904:0:5811:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.140@tcp ctxt 1 is initialized 10000000:01000000:3.0:1789127175.638617:0:5827:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1789127175.638673:0:5811:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.140@tcp (uuid c7954fd6-d5aa-44a8-939c-a8f1c4c7519e) 00000020:00000080:3.0:1789127175.638704:0:5811:0:(genops.c:1385:class_connect()) connect: client c7954fd6-d5aa-44a8-939c-a8f1c4c7519e, cookie 0xeeacf7c0243000de 00000100:00080000:3.0:1789127175.638721:0:5811:0:(import.c:510:import_select_connection()) MGC192.168.206.140@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789127175.638728:0:5811:0:(import.c:624:import_select_connection()) MGC192.168.206.140@tcp: import 0000000039019b34 using connection 192.168.206.140@tcp/0@lo 00000100:00100000:3.0:1789127175.638770:0:5811:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000009342e7ba x1876035752689792/t0(0) o250->MGC192.168.206.140@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789127175.641393:0:5811:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import c7954fd6-d5aa-44a8-939c-a8f1c4c7519e->MGS 00000020:01000004:3.0:1789127175.641433:0:5811:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1789127175.641443:0:5811:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1789127175.641470:0:5811:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000008d7acccf) 00000020:00000080:3.0:1789127175.641496:0:5811:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1789127175.643020:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009342e7ba pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3299:1876035752689792:0@lo:250: 00000100:00100000:2.0:1789127175.643127:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127175.643377:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752689792 00000100:00100000:1.0:1789127175.643388:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752689792 00000100:00100000:1.0:1789127175.643425:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789127175.643433:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c429499c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3299:x1876035752689792:12345-0@lo:250: 00010000:00080000:1.0:1789127175.643464:0:5822:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from c7954fd6-d5aa-44a8-939c-a8f1c4c7519e@0@lo t0 exp 0000000000000000 cur 121 last 0 00000020:00000080:1.0:1789127175.643495:0:5822:0:(genops.c:1385:class_connect()) connect: client c7954fd6-d5aa-44a8-939c-a8f1c4c7519e, cookie 0xeeacf7c0243000ec 00000100:00080000:1.0:1789127175.643653:0:5822:0:(import.c:65:import_set_state_nolock()) 0000000016ee3a24 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789127175.643741:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c429499c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+5:3299:x1876035752689792:12345-0@lo:250: Request processed in 307us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127175.643750:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789127175.645639:0:3299:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.206.140@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1789127175.645658:0:3299:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.206.140@tcp: connect to target with instance 0 00000100:00080000:2.0:1789127175.645669:0:3299:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.206.140@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1789127175.645675:0:3299:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1789127175.645679:0:3299:0:(import.c:65:import_set_state_nolock()) 0000000039019b34 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1789127175.645684:0:3299:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1789127175.645695:0:3299:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1789127175.645703:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009342e7ba pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3299:1876035752689792:0@lo:250: 00000100:00100000:2.0:1789127175.667523:0:5811:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789127175.667764:0:5811:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1789127175.667771:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1789127175.675274:0:5811:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1789127175.675287:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1789127175.675696:0:5811:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1789127175.675705:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1789127175.679840:0:5811:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789127175.680024:0:5811:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1789127175.680030:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1789127175.680745:0:5811:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1789127175.680753:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1789127175.748650:0:5811:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789127175.749218:0:5811:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1789127175.749226:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1789127175.755072:0:5811:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1789127175.755093:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1789127175.757053:0:5811:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789127175.757311:0:5811:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789127175.757316:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1789127175.758485:0:5811:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789127175.758494:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1789127175.762756:0:5811:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789127175.762984:0:5811:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789127175.762990:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1789127175.766047:0:5811:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789127175.766061:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1789127175.766667:0:5811:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789127175.767046:0:5811:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789127175.767051:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1789127175.770189:0:5811:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789127175.770202:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1789127175.823439:0:5811:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789127175.823631:0:5811:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789127175.823636:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1789127175.826183:0:5811:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789127175.826197:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1789127175.840600:0:5811:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1789127175.840616:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1789127175.846480:0:5811:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1789127175.846700:0:5811:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1789127175.846707:0:5811:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.140@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1789127175.847262:0:5811:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.140@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789127175.847296:0:5811:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.140@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1789127175.847300:0:5811:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789127175.847302:0:5811:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789127175.847304:0:5811:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789127175.847305:0:5811:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789127175.847306:0:5811:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789127175.847307:0:5811:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789127175.847308:0:5811:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789127175.847310:0:5811:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789127175.847311:0:5811:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789127175.847312:0:5811:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789127175.847314:0:5811:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789127175.847316:0:5811:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789127175.847318:0:5811:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1789127175.847320:0:5811:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789127175.847321:0:5811:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789127175.847323:0:5811:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789127175.847324:0:5811:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789127175.847325:0:5811:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789127175.847326:0:5811:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789127175.847326:0:5811:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789127175.847327:0:5811:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789127175.847328:0:5811:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789127175.847329:0:5811:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789127175.847330:0:5811:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789127175.847331:0:5811:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789127175.847358:0:5811:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1789127175.847376:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009342e7ba pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5811:1876035752689920:0@lo:253: 00000100:00100000:3.0:1789127175.847457:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127175.849433:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set 0000000098951b6c going to sleep for 11 seconds 00000100:00100000:0.0:1789127175.852547:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752689920 00000100:00100000:0.0:1789127175.852562:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752689920 00000100:00100000:0.0:1789127175.852637:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789127175.852646:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000026badf06 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+5:5811:x1876035752689920:12345-0@lo:253: 20000000:01000000:0.0:1789127175.852698:0:5825:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789127175.852701:0:5825:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:2.0:1789127175.854608:0:5846:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1789127175.854666:0:5825:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1789127175.857410:0:5825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789127175.868139:0:5847:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1789127175.868417:0:5825:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789127175.868422:0:5825:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1789127175.868428:0:5825:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1789127175.868431:0:5825:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1789127175.868443:0:5825:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1789127175.868680:0:5825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789127175.869384:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1789127175.869401:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789127175.869457:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1789127175.869508:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1789127175.869546:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1789127175.869649:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1789127175.869658:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1789127175.869704:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1789127175.869712:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1789127175.870097:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1789127175.870107:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1789127175.870139:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1789127175.870201:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1789127175.870238:0:5825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1789127175.870243:0:5825:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1789127175.870254:0:5825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789127175.870435:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1789127175.870445:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1789127175.870476:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1789127175.870506:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1789127175.870568:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1789127175.870580:0:5825:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1789127175.870650:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1789127175.870658:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1789127175.870700:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1789127175.870735:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1789127175.873309:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1789127175.873351:0:5825:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1789127175.873566:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1789127175.873577:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1789127175.873615:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1789127175.873651:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1789127175.874088:0:5825:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1789127175.874139:0:5825:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1789127175.874148:0:5825:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1789127175.874629:0:5848:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1789127175.875239:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1789127175.875262:0:5825:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.206.140@tcp for mdt 20000000:01000000:1.0:1789127175.875264:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.140@tcp (null) (null) (null) 00000040:00080000:1.0:1789127175.875295:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1789127175.875302:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1789127175.875347:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1789127175.875355:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.206.140@tcp (null) (null) 00000040:00080000:1.0:1789127175.875397:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1789127175.875406:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1789127175.875437:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1789127175.875469:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1789127175.875523:0:5825:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1789127175.875526:0:5825:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1789127175.875532:0:5825:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1789127175.875537:0:5825:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1789127175.883126:0:5849:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:1.0:1789127175.883277:0:5825:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1789127175.896542:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1789127175.896633:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:0.0:1789127175.896714:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:0.0:1789127175.896736:0:5825:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1789127175.896739:0:5825:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1789127175.896742:0:5825:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1789127175.897687:0:5825:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1789127175.897691:0:5825:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1789127175.897730:0:5825:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1789127175.897733:0:5825:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:2.0:1789127175.901539:0:5850:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1789127175.902595:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1789127175.902649:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1789127175.902689:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:0.0:1789127175.902704:0:5825:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1789127175.902707:0:5825:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1789127175.903416:0:5851:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:1.0:1789127175.903646:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:1.0:1789127175.903684:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:1.0:1789127175.903768:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 00000020:00000080:1.0:1789127175.904060:0:5825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789127175.904069:0:5825:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:1.0:1789127175.904077:0:5825:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789127175.904098:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000ee9cefeb/0xeeacf7c0243000f3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127175.904114:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ee9cefeb/0xeeacf7c0243000f3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127175.904124:0:5825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ee9cefeb/0xeeacf7c0243000f3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127175.904130:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ee9cefeb/0xeeacf7c0243000f3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127175.904137:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000ee9cefeb/0xeeacf7c0243000f3 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127175.904143:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000ee9cefeb/0xeeacf7c0243000f3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127175.904148:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ee9cefeb already unused, calling callback (000000009f7ec753) 00010000:00010000:1.0:1789127175.904152:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000ee9cefeb/0xeeacf7c0243000f3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127175.904158:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000ee9cefeb/0xeeacf7c0243000f3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127175.904169:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000ee9cefeb/0xeeacf7c0243000f3 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127175.904175:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000ee9cefeb/0xeeacf7c0243000f3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127175.904190:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ee9cefeb/0xeeacf7c0243000f3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789127175.904208:0:5825:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1789127176.149408:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000026badf06 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+5:5811:x1876035752689920:12345-0@lo:253: Request processed in 296756us (301943us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127176.149425:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789127176.149504:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009342e7ba pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5811:1876035752689920:0@lo:253: 10000000:01000000:3.0:1789127176.149519:0:5811:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1789127176.149522:0:5811:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789127176.149523:0:5811:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789127176.149525:0:5811:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789127176.149526:0:5811:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1789127176.149527:0:5811:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789127176.149528:0:5811:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789127176.149530:0:5811:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789127176.149531:0:5811:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789127176.149532:0:5811:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1789127176.149534:0:5811:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789127176.149535:0:5811:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789127176.149551:0:5811:0:(tgt_mount.c:101:server_register_mount()) register mount 000000001873f978 from lustre-MDT0000 10000000:01000000:3.0:1789127176.149575:0:5811:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1789127176.149578:0:5811:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789127176.149581:0:5811:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8df790d38000 10000000:01000000:3.0:1789127176.149585:0:5811:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789127176.149592:0:5811:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8df790d38000 from 1 10000000:01000000:3.0:1789127176.149594:0:5811:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789127176.149634:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: 00000000466c8d8e/0xeeacf7c0243000fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127176.149643:0:5811:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: 00000000466c8d8e/0xeeacf7c0243000fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127176.149652:0:5811:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: 00000000466c8d8e/0xeeacf7c0243000fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127176.149669:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009342e7ba pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5811:1876035752690048:0@lo:101: 00000100:00100000:3.0:1789127176.149705:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127176.149978:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cfd096fb going to sleep for 11 seconds 00000100:00100000:1.0:1789127176.150074:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752690048 00000100:00100000:1.0:1789127176.150080:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752690048 00000100:00100000:1.0:1789127176.150221:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789127176.150230:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004e8dae9e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+5:5811:x1876035752690048:12345-0@lo:101: 00010000:00010000:1.0:1789127176.150243:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127176.150255:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ee9cefeb/0xeeacf7c024300101 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xeeacf7c0243000fa expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127176.150275:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ee9cefeb/0xeeacf7c024300101 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xeeacf7c0243000fa expref: 6 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127176.150284:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ee9cefeb/0xeeacf7c024300101 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c0243000fa expref: 6 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127176.150292:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ee9cefeb, rc 0) 00000100:00100000:1.0:1789127176.150372:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004e8dae9e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+6:5811:x1876035752690048:12345-0@lo:101: Request processed in 143us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127176.150378:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789127176.150452:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009342e7ba pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5811:1876035752690048:0@lo:101: 00010000:00010000:3.0:1789127176.150466:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: 00000000466c8d8e/0xeeacf7c0243000fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c024300101 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127176.150474:0:5811:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: 00000000466c8d8e/0xeeacf7c0243000fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xeeacf7c024300101 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127176.150522:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009342e7ba pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5811:1876035752690176:0@lo:501: 00000100:00100000:3.0:1789127176.150546:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127176.151736:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cfd096fb going to sleep for 11 seconds 00000100:00100000:1.0:1789127176.152232:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752690176 00000100:00100000:1.0:1789127176.152240:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752690176 00000100:00100000:1.0:1789127176.152289:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789127176.152306:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007a69abca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+6:5811:x1876035752690176:12345-0@lo:501: 00000100:00100000:1.0:1789127176.152544:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007a69abca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+6:5811:x1876035752690176:12345-0@lo:501: Request processed in 238us (1998us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789127176.152551:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789127176.152639:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009342e7ba pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5811:1876035752690176:0@lo:501: 10000000:01000000:0.0:1789127176.152672:0:5811:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789127176.152684:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: 00000000466c8d8e/0xeeacf7c0243000fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c024300101 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127176.152693:0:5811:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: 00000000466c8d8e/0xeeacf7c0243000fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c024300101 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127176.152701:0:5811:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8df788820800 10000000:01000000:0.0:1789127176.152705:0:5811:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789127176.152708:0:5811:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8df788820800 10000000:01000000:0.0:1789127176.152711:0:5811:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1789127176.152713:0:5811:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8df788820800 from 1 10000000:01000000:0.0:1789127176.152716:0:5811:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1789127176.152741:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: 0000000016598163/0xeeacf7c024300108 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127176.152767:0:5811:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: 0000000016598163/0xeeacf7c024300108 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127176.152783:0:5811:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: 0000000016598163/0xeeacf7c024300108 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127176.152817:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f95d2443 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5811:1876035752690304:0@lo:101: 00000100:00100000:0.0:1789127176.152948:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127176.152975:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set 00000000058cd87e going to sleep for 11 seconds 00000100:00100000:1.0:1789127176.153026:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752690304 00000100:00100000:1.0:1789127176.153029:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752690304 00000100:00100000:1.0:1789127176.153047:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789127176.153051:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005d247cfe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+6:5811:x1876035752690304:12345-0@lo:101: 00010000:00010000:1.0:1789127176.153059:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127176.153069:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000cdd84908/0xeeacf7c02430010f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xeeacf7c024300108 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127176.153086:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000cdd84908/0xeeacf7c02430010f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xeeacf7c024300108 expref: 7 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127176.153094:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000cdd84908/0xeeacf7c02430010f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c024300108 expref: 7 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127176.153102:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000cdd84908, rc 0) 00000100:00100000:1.0:1789127176.153197:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005d247cfe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+7:5811:x1876035752690304:12345-0@lo:101: Request processed in 145us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127176.153203:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789127176.153300:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f95d2443 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5811:1876035752690304:0@lo:101: 00010000:00010000:0.0:1789127176.153311:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: 0000000016598163/0xeeacf7c024300108 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c02430010f expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127176.153318:0:5811:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: 0000000016598163/0xeeacf7c024300108 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xeeacf7c02430010f expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127176.153331:0:5811:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1789127176.153333:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: 0000000016598163/0xeeacf7c024300108 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c02430010f expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127176.153339:0:5811:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: 0000000016598163/0xeeacf7c024300108 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c02430010f expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127176.153345:0:5811:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789127176.153348:0:5811:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789127176.153352:0:5811:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8df788820800 10000000:01000000:0.0:1789127176.153354:0:5811:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1789127176.153356:0:5811:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1789127176.153363:0:5811:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789127176.153375:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: 00000000a53d3a98/0xeeacf7c024300116 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127176.153381:0:5811:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: 00000000a53d3a98/0xeeacf7c024300116 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127176.153387:0:5811:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: 00000000a53d3a98/0xeeacf7c024300116 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127176.153396:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f95d2443 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5811:1876035752690432:0@lo:101: 00000100:00100000:0.0:1789127176.153417:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127176.153434:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set 00000000058cd87e going to sleep for 11 seconds 00000100:00100000:1.0:1789127176.153477:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752690432 00000100:00100000:1.0:1789127176.153480:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752690432 00000100:00100000:1.0:1789127176.153504:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789127176.153509:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f2c4484e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+7:5811:x1876035752690432:12345-0@lo:101: 00010000:00010000:1.0:1789127176.153515:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127176.153520:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d544e934/0xeeacf7c02430011d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xeeacf7c024300116 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127176.153536:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d544e934/0xeeacf7c02430011d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xeeacf7c024300116 expref: 8 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127176.153543:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d544e934/0xeeacf7c02430011d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c024300116 expref: 8 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127176.153549:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d544e934, rc 0) 00000100:00100000:1.0:1789127176.153577:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f2c4484e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+8:5811:x1876035752690432:12345-0@lo:101: Request processed in 69us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127176.153582:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789127176.153667:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f95d2443 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5811:1876035752690432:0@lo:101: 00010000:00010000:0.0:1789127176.153675:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: 00000000a53d3a98/0xeeacf7c024300116 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c02430011d expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127176.153681:0:5811:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: 00000000a53d3a98/0xeeacf7c024300116 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xeeacf7c02430011d expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127176.153716:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f95d2443 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5811:1876035752690560:0@lo:501: 00000100:00100000:0.0:1789127176.153736:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127176.153759:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set 00000000058cd87e going to sleep for 11 seconds 00000100:00100000:1.0:1789127176.153931:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752690560 00000100:00100000:1.0:1789127176.153936:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752690560 00000100:00100000:1.0:1789127176.153963:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789127176.153969:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003c2c277a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+8:5811:x1876035752690560:12345-0@lo:501: 00000100:00100000:1.0:1789127176.154289:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003c2c277a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+9:5811:x1876035752690560:12345-0@lo:501: Request processed in 320us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127176.154296:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789127176.154367:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f95d2443 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5811:1876035752690560:0@lo:501: 00000100:00100000:0.0:1789127176.154395:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f95d2443 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5811:1876035752690688:0@lo:503: 00000100:00100000:0.0:1789127176.154429:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127176.154495:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set 00000000058cd87e going to sleep for 11 seconds 00000100:00100000:3.0:1789127176.154562:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752690688 00000100:00100000:3.0:1789127176.154567:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752690688 00000100:00100000:3.0:1789127176.154596:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789127176.154602:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e1b51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+9:5811:x1876035752690688:12345-0@lo:503: 00000100:00100000:3.0:1789127176.155208:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e1b51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+9:5811:x1876035752690688:12345-0@lo:503: Request processed in 604us (776us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127176.155217:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789127176.156993:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f95d2443 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5811:1876035752690688:0@lo:503: 00000100:00100000:2.0:1789127176.157493:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000003c47f86 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5853:1876035752690816:0@lo:502: 00000100:00100000:2.0:1789127176.157558:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127176.157643:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set 00000000dff53371 going to sleep for 11 seconds 00000100:00100000:1.0:1789127176.157682:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752690816 00000100:00100000:1.0:1789127176.157688:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752690816 00000100:00100000:1.0:1789127176.157765:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789127176.157773:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006babfb88 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+9:5853:x1876035752690816:12345-0@lo:502: 00000100:00100000:1.0:1789127176.158246:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006babfb88 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+9:5853:x1876035752690816:12345-0@lo:502: Request processed in 474us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127176.158254:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789127176.158356:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000003c47f86 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5853:1876035752690816:0@lo:502: 00000020:01000000:2.0:1789127176.158383:0:5853:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789127176.158395:0:5853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127176.158397:0:5853:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789127176.158401:0:5853:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1789127176.158405:0:5853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789127176.158429:0:5853:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (0000000079907eb2) 00000020:00000080:2.0:1789127176.158447:0:5853:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1789127176.158453:0:5853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1789127176.158527:0:5853:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:2.0:1789127176.158535:0:5853:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xeeacf7c02430012b 00000020:00000080:2.0:1789127176.158764:0:5853:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1789127176.158769:0:5853:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789127176.158773:0:5853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127176.158785:0:5853:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789127176.158807:0:5853:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789127176.158812:0:5853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127176.158813:0:5853:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1789127176.158817:0:5853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789127176.158824:0:5853:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000a324e8a7) 00000020:00000080:2.0:1789127176.158842:0:5853:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1789127176.158847:0:5853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1789127176.158854:0:5853:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1789127176.158857:0:5853:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1789127176.158863:0:5853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789127176.158916:0:5853:0:(tgt_mount.c:153:server_get_mount()) get mount 000000001873f978 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1789127176.158930:0:5853:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000aab2844c) 00000020:00000080:2.0:1789127176.158938:0:5853:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1789127176.158986:0:5853:0:(lod_dev.c:2292:lod_obd_connect()) connect #0 00000020:00000080:2.0:1789127176.158991:0:5853:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xeeacf7c024300140 00000020:00000080:2.0:1789127176.159072:0:5853:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1789127176.159079:0:5853:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1789127176.159083:0:5853:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xeeacf7c024300147 00080000:01000000:2.0:1789127176.159087:0:5853:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:2.0:1789127176.159090:0:5853:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xeeacf7c02430014e 00080000:10000000:2.0:1789127176.159474:0:5853:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:2.0:1789127176.159684:0:5853:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:0.0:1789127176.167458:0:5853:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1789127176.242657:0:5853:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1789127176.243472:0:5853:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1789127176.249457:0:5853:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1789127176.253012:0:5853:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1789127176.293997:0:5853:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000e0844524) 00000020:00000080:2.0:1789127176.294025:0:5853:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1789127176.294136:0:5853:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:2.0:1789127176.294143:0:5853:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xeeacf7c02430015c 00000020:00000080:3.0:1789127176.298313:0:5853:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1789127176.299739:0:5853:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:2.0:1789127176.327462:0:5853:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1789127176.358205:0:5853:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1789127176.392631:0:5853:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:3.0:1789127176.435581:0:5853:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:2.0:1789127176.468118:0:5853:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:2.0:1789127176.502399:0:5853:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xeeacf7c024300163 00000020:00000080:3.0:1789127176.503209:0:5853:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1789127176.503222:0:5853:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789127176.503229:0:5853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127176.503231:0:5853:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1789127176.503234:0:5853:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789127176.503247:0:5853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127176.503248:0:5853:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1789127176.503253:0:5853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1789127176.503292:0:5853:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1789127176.503310:0:5853:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789127176.503313:0:5853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127176.503314:0:5853:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1789127176.503316:0:5853:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789127176.503318:0:5853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127176.503320:0:5853:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789127176.503323:0:5853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789127176.503325:0:5853:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1789127176.503363:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bf6c1f64 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5853:1876035752690944:0@lo:502: 00000100:00100000:3.0:1789127176.503440:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127176.503576:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set 0000000031d3e819 going to sleep for 11 seconds 00000100:00100000:1.0:1789127176.503689:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752690944 00000100:00100000:1.0:1789127176.503696:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752690944 00000100:00100000:1.0:1789127176.503820:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789127176.503835:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000559231ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+9:5853:x1876035752690944:12345-0@lo:502: 00000100:00100000:1.0:1789127176.504223:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000559231ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+9:5853:x1876035752690944:12345-0@lo:502: Request processed in 389us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127176.504232:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789127176.504297:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bf6c1f64 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5853:1876035752690944:0@lo:502: 00000020:01000000:2.0:1789127176.504327:0:5853:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789127176.504333:0:5853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127176.504336:0:5853:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789127176.504339:0:5853:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1789127176.504487:0:5811:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1789127176.504506:0:5811:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789127176.504525:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: 00000000a53d3a98/0xeeacf7c024300116 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c02430011d expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127176.504535:0:5811:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: 00000000a53d3a98/0xeeacf7c024300116 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c02430011d expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127176.504542:0:5811:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8df788820800 from 1 10000000:01000000:0.0:1789127176.504545:0:5811:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789127176.504571:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: 00000000066dcd69/0xeeacf7c02430016a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127176.504578:0:5811:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: 00000000066dcd69/0xeeacf7c02430016a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127176.504585:0:5811:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: 00000000066dcd69/0xeeacf7c02430016a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127176.504598:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f95d2443 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5811:1876035752691072:0@lo:101: 00000100:00100000:0.0:1789127176.504634:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127176.504767:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set 0000000079be7946 going to sleep for 11 seconds 00000100:00100000:3.0:1789127176.505031:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752691072 00000100:00100000:3.0:1789127176.505037:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752691072 00000100:00100000:3.0:1789127176.505064:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789127176.505069:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000edafaabc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+9:5811:x1876035752691072:12345-0@lo:101: 00010000:00010000:3.0:1789127176.505079:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127176.505091:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003b770210/0xeeacf7c024300171 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xeeacf7c02430016a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127176.505111:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003b770210/0xeeacf7c024300171 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xeeacf7c02430016a expref: 10 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127176.505120:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003b770210/0xeeacf7c024300171 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c02430016a expref: 10 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127176.505128:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003b770210, rc 0) 00000100:00100000:3.0:1789127176.505159:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000edafaabc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+10:5811:x1876035752691072:12345-0@lo:101: Request processed in 90us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127176.505173:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789127176.505253:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f95d2443 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5811:1876035752691072:0@lo:101: 00010000:00010000:0.0:1789127176.505266:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: 00000000066dcd69/0xeeacf7c02430016a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c024300171 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127176.505274:0:5811:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: 00000000066dcd69/0xeeacf7c02430016a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xeeacf7c024300171 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127176.505941:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f95d2443 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5811:1876035752691200:0@lo:256: 00000100:00100000:0.0:1789127176.505981:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127176.506011:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set 0000000079be7946 going to sleep for 11 seconds 00000100:00100000:3.0:1789127176.506072:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752691200 00000100:00100000:3.0:1789127176.506077:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752691200 00000100:00100000:3.0:1789127176.506103:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789127176.506108:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000012d2ded2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+10:5811:x1876035752691200:12345-0@lo:256: 20000000:01000000:3.0:1789127176.506122:0:5822:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1789127176.506127:0:5822:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1789127176.506204:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000012d2ded2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+10:5811:x1876035752691200:12345-0@lo:256: Request processed in 95us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127176.506211:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789127176.506279:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f95d2443 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5811:1876035752691200:0@lo:256: 10000000:01000000:0.0:1789127176.506985:0:5811:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789127176.506997:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: 00000000066dcd69/0xeeacf7c02430016a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c024300171 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127176.507006:0:5811:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: 00000000066dcd69/0xeeacf7c02430016a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c024300171 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127176.507013:0:5811:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df788820800 from 1 10000000:01000000:0.0:1789127176.507016:0:5811:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789127176.507040:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: 00000000eebfa228/0xeeacf7c024300178 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127176.507046:0:5811:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: 00000000eebfa228/0xeeacf7c024300178 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127176.507053:0:5811:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: 00000000eebfa228/0xeeacf7c024300178 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127176.507067:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f95d2443 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5811:1876035752691328:0@lo:101: 00000100:00100000:0.0:1789127176.507099:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127176.507121:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set 0000000079be7946 going to sleep for 11 seconds 00000100:00100000:1.0:1789127176.507204:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752691328 00000100:00100000:1.0:1789127176.507211:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752691328 00000100:00100000:1.0:1789127176.507244:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789127176.507250:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000008796e16 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+10:5811:x1876035752691328:12345-0@lo:101: 00010000:00010000:1.0:1789127176.507260:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127176.507270:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d9720fc5/0xeeacf7c02430017f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xeeacf7c024300178 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127176.507287:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d9720fc5/0xeeacf7c02430017f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xeeacf7c024300178 expref: 11 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127176.507296:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d9720fc5/0xeeacf7c02430017f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c024300178 expref: 11 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127176.507303:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d9720fc5, rc 0) 00000100:00100000:1.0:1789127176.507331:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000008796e16 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+11:5811:x1876035752691328:12345-0@lo:101: Request processed in 82us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127176.507336:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789127176.507413:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f95d2443 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5811:1876035752691328:0@lo:101: 00010000:00010000:0.0:1789127176.507426:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: 00000000eebfa228/0xeeacf7c024300178 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c02430017f expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127176.507442:0:5811:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: 00000000eebfa228/0xeeacf7c024300178 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xeeacf7c02430017f expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127176.507487:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f95d2443 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5811:1876035752691456:0@lo:501: 00000100:00100000:0.0:1789127176.507509:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127176.507534:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set 0000000079be7946 going to sleep for 11 seconds 00000100:00100000:3.0:1789127176.507598:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752691456 00000100:00100000:3.0:1789127176.507602:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752691456 00000100:00100000:3.0:1789127176.507618:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789127176.507623:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009b310294 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+11:5811:x1876035752691456:12345-0@lo:501: 00000100:00100000:3.0:1789127176.508167:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009b310294 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+11:5811:x1876035752691456:12345-0@lo:501: Request processed in 542us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127176.508175:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789127176.508281:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f95d2443 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5811:1876035752691456:0@lo:501: 00000100:00100000:0.0:1789127176.508311:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f95d2443 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5811:1876035752691584:0@lo:503: 00000100:00100000:0.0:1789127176.508348:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127176.508372:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set 0000000079be7946 going to sleep for 11 seconds 00000100:00100000:1.0:1789127176.508423:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752691584 00000100:00100000:1.0:1789127176.508428:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752691584 00000100:00100000:1.0:1789127176.508447:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789127176.508452:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005a47fbf1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+11:5811:x1876035752691584:12345-0@lo:503: 00000040:00080000:1.0:1789127176.508484:0:5825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789127176.508523:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005a47fbf1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+11:5811:x1876035752691584:12345-0@lo:503: Request processed in 71us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127176.508535:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789127176.508603:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f95d2443 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5811:1876035752691584:0@lo:503: 00000040:00080000:0.0:1789127176.509730:0:5857:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1789127176.510194:0:5811:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1789127176.510216:0:5811:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789127176.510266:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: 00000000eebfa228/0xeeacf7c024300178 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c02430017f expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127176.510278:0:5811:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: 00000000eebfa228/0xeeacf7c024300178 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c02430017f expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789127176.510320:0:5811:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789127176.510323:0:5811:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8df788820800 10000000:01000000:1.0:1789127176.510326:0:5811:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8df788820800 10000000:01000000:1.0:1789127176.510329:0:5811:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789127176.510334:0:5811:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8df788820800 from 1 10000000:01000000:1.0:1789127176.510337:0:5811:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789127176.510368:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: 0000000084bd5e54/0xeeacf7c024300186 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127176.510375:0:5811:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: 0000000084bd5e54/0xeeacf7c024300186 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127176.510382:0:5811:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: 0000000084bd5e54/0xeeacf7c024300186 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127176.510399:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000060fa91f3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5811:1876035752691712:0@lo:101: 00000100:00100000:1.0:1789127176.510454:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127176.510493:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set 000000009ea0b94e going to sleep for 11 seconds 00000100:00100000:2.0:1789127176.510546:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752691712 00000100:00100000:2.0:1789127176.510553:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752691712 00000100:00100000:2.0:1789127176.510598:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789127176.510605:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000012ddb347 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+11:5811:x1876035752691712:12345-0@lo:101: 00010000:00010000:2.0:1789127176.510618:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127176.510630:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ff8023b2/0xeeacf7c02430018d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xeeacf7c024300186 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127176.510649:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ff8023b2/0xeeacf7c02430018d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xeeacf7c024300186 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127176.510658:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ff8023b2/0xeeacf7c02430018d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c024300186 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127176.510665:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ff8023b2, rc 0) 00000100:00100000:2.0:1789127176.510707:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000012ddb347 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+12:5811:x1876035752691712:12345-0@lo:101: Request processed in 102us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127176.510713:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789127176.510948:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000060fa91f3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5811:1876035752691712:0@lo:101: 00010000:00010000:1.0:1789127176.510962:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: 0000000084bd5e54/0xeeacf7c024300186 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c02430018d expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127176.510984:0:5811:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: 0000000084bd5e54/0xeeacf7c024300186 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xeeacf7c02430018d expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127176.511032:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000060fa91f3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5811:1876035752691840:0@lo:501: 00000100:00100000:1.0:1789127176.511057:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127176.511075:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set 000000009ea0b94e going to sleep for 11 seconds 00000100:00100000:0.0:1789127176.511126:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752691840 00000100:00100000:0.0:1789127176.511130:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752691840 00000100:00100000:0.0:1789127176.511161:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789127176.511167:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a84045f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+12:5811:x1876035752691840:12345-0@lo:501: 00000100:00100000:0.0:1789127176.511390:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a84045f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+12:5811:x1876035752691840:12345-0@lo:501: Request processed in 223us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127176.511396:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789127176.511519:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000060fa91f3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5811:1876035752691840:0@lo:501: 00000100:00100000:1.0:1789127176.511543:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000060fa91f3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5811:1876035752691968:0@lo:503: 00000100:00100000:1.0:1789127176.511577:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127176.511596:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set 000000009ea0b94e going to sleep for 11 seconds 00000100:00100000:1.0:1789127176.511609:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752691968 00000100:00100000:1.0:1789127176.511612:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752691968 00000100:00100000:1.0:1789127176.511631:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789127176.511635:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005dcb338f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+12:5811:x1876035752691968:12345-0@lo:503: 00000100:00100000:1.0:1789127176.511785:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005dcb338f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+12:5811:x1876035752691968:12345-0@lo:503: Request processed in 149us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127176.511812:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789127176.511847:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000060fa91f3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5811:1876035752691968:0@lo:503: 00000100:00100000:0.0:1789127176.512231:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f95d2443 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5858:1876035752692096:0@lo:502: 00000100:00100000:0.0:1789127176.512268:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127176.512301:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cb13b3b2 going to sleep for 11 seconds 00000100:00100000:1.0:1789127176.512347:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752692096 00000100:00100000:1.0:1789127176.512351:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752692096 00000100:00100000:1.0:1789127176.512378:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789127176.512385:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000089da36a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+12:5858:x1876035752692096:12345-0@lo:502: 00000100:00100000:1.0:1789127176.512536:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000089da36a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+12:5858:x1876035752692096:12345-0@lo:502: Request processed in 152us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127176.512546:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789127176.512629:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f95d2443 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5858:1876035752692096:0@lo:502: 00000020:01000004:0.0:1789127176.512680:0:5858:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1789127176.512705:0:5858:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000003c4fa605) 00000020:00000080:0.0:1789127176.512723:0:5858:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1789127176.512867:0:5858:0:(tgt_mount.c:153:server_get_mount()) get mount 000000001873f978 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1789127176.512871:0:5858:0:(tgt_mount.c:187:server_put_mount()) put mount 000000001873f978 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1789127176.512873:0:5858:0:(obd_mount.c:710:lustre_put_lsi()) put 000000001873f978 4 00010000:00080000:0.0:1789127176.512899:0:5858:0:(ldlm_lib.c:102:import_set_conn()) imp 000000008308fe15@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.140@tcp at head 00010000:00010000:0.0:1789127176.514423:0:5858:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1789127176.514626:0:5858:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1789127176.514658:0:5858:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789127176.514670:0:5858:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xeeacf7c02430019b 00000100:00080000:0.0:1789127176.514679:0:5858:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789127176.514684:0:5858:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000008308fe15 using connection 192.168.206.140@tcp/0@lo 00000100:00100000:0.0:1789127176.514717:0:5858:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000f95d2443 x1876035752692224/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789127176.514761:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f95d2443 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876035752692224:0@lo:38: 00000100:00100000:0.0:1789127176.514876:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789127176.514929:0:5858:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789127176.517005:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752692224 00000100:00100000:2.0:1789127176.517019:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752692224 00000100:00100000:2.0:1789127176.517053:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789127176.517059:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009e9e5411 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3299:x1876035752692224:12345-0@lo:38: 00000100:00100000:2.0:1789127176.517145:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009e9e5411 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3299:x1876035752692224:12345-0@lo:38: Request processed in 85us (2269us total) trans 0 rc -11/-11 00000100:00100000:2.0:1789127176.517152:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789127176.517198:0:3299:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789127176.517207:0:3299:0:(import.c:65:import_set_state_nolock()) 000000008308fe15 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789127176.517211:0:3299:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1789127176.517214:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f95d2443 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876035752692224:0@lo:38: 00000100:00100000:0.0:1789127176.517539:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000002e20520 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5858:1876035752692352:0@lo:502: 00000100:00100000:0.0:1789127176.520342:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127176.520885:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set 000000000c6c2015 going to sleep for 11 seconds 00000100:00100000:3.0:1789127176.521988:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752692352 00000100:00100000:3.0:1789127176.521998:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752692352 00000100:00100000:3.0:1789127176.522085:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789127176.522094:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000639cdd29 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+12:5858:x1876035752692352:12345-0@lo:502: 00000100:00100000:3.0:1789127176.522353:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000639cdd29 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+12:5858:x1876035752692352:12345-0@lo:502: Request processed in 260us (2017us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127176.522361:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789127176.522442:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000002e20520 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5858:1876035752692352:0@lo:502: 00000040:00080000:0.0:1789127176.522475:0:5858:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:1.0:1789127176.523586:0:5811:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1789127176.523608:0:5811:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789127176.523629:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: 0000000084bd5e54/0xeeacf7c024300186 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c02430018d expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127176.523640:0:5811:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: 0000000084bd5e54/0xeeacf7c024300186 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c02430018d expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789127176.523682:0:5811:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789127176.523685:0:5811:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789127176.523686:0:5811:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789127176.523688:0:5811:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789127176.523689:0:5811:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789127176.523691:0:5811:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789127176.523692:0:5811:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789127176.523693:0:5811:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789127176.523695:0:5811:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789127176.523696:0:5811:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789127176.523698:0:5811:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789127176.523699:0:5811:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789127176.523702:0:5811:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1789127176.523705:0:5811:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789127176.523706:0:5811:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789127176.523707:0:5811:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789127176.523708:0:5811:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789127176.523709:0:5811:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789127176.523710:0:5811:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789127176.523711:0:5811:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789127176.523712:0:5811:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789127176.523713:0:5811:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789127176.523714:0:5811:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789127176.523715:0:5811:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789127176.523716:0:5811:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789127176.523735:0:5811:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1789127176.523870:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000060fa91f3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5811:1876035752692480:0@lo:253: 00000100:00100000:1.0:1789127176.523928:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127176.523964:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set 0000000033da3495 going to sleep for 11 seconds 00000100:00100000:0.0:1789127176.524012:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752692480 00000100:00100000:0.0:1789127176.524017:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752692480 00000100:00100000:0.0:1789127176.524057:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789127176.524064:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000758cd260 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+12:5811:x1876035752692480:12345-0@lo:253: 20000000:01000000:0.0:1789127176.524087:0:5824:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1789127176.524105:0:5824:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789127176.544125:0:5824:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789127176.544147:0:5824:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1789127176.544188:0:5846:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789127176.544194:0:5846:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789127176.544215:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000e122e194/0xeeacf7c0243001a2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127176.544232:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000003b770210/0xeeacf7c024300171 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c02430016a expref: 12 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127176.544244:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000e122e194/0xeeacf7c0243001a2 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127176.544279:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000003b770210/0xeeacf7c024300171 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xeeacf7c02430016a expref: 12 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127176.544292:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000003b770210/0xeeacf7c024300171 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xeeacf7c02430016a expref: 12 pid: 5822 timeout: 272 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127176.544305:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000002e20520 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5846:1876035752692608:0@lo:104: 00000100:00100000:0.0:1789127176.544366:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127176.544427:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set 00000000204b8734 going to sleep for 11 seconds 00000100:00100000:1.0:1789127176.544737:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752692608 00000100:00100000:1.0:1789127176.544753:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752692608 00000100:00100000:1.0:1789127176.544829:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789127176.544837:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008e21beed pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+3:5846:x1876035752692608:12345-0@lo:104: 00010000:00010000:1.0:1789127176.544849:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.140@tcp lock: 00000000066dcd69/0xeeacf7c02430016a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xeeacf7c024300171 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127176.544903:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789127176.544908:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008e21beed pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+3:5846:x1876035752692608:12345-0@lo:104: Request processed in 73us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127176.544916:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1789127176.544936:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789127176.544941:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.140@tcp lock: 00000000066dcd69/0xeeacf7c02430016a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xeeacf7c024300171 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127176.544948:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000066dcd69 already unused, calling callback (00000000eaae6637) 10000000:00010000:1.0:1789127176.544951:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.140@tcp lock: 00000000066dcd69/0xeeacf7c02430016a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xeeacf7c024300171 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127176.544959:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: 00000000066dcd69/0xeeacf7c02430016a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xeeacf7c024300171 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789127176.544964:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: 00000000066dcd69/0xeeacf7c02430016a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xeeacf7c024300171 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789127176.544970:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789127176.544993:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.140@tcp lock: 00000000066dcd69/0xeeacf7c02430016a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c024300171 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127176.545019:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789127176.545035:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.140@tcp lock: 00000000066dcd69/0xeeacf7c02430016a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c024300171 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127176.545041:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: 00000000066dcd69/0xeeacf7c02430016a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c024300171 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127176.545057:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127176.545059:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127176.545060:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127176.545235:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789127176.545247:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000095dd62b2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3300:1876035752692736:0@lo:103: 00000100:00100000:0.0:1789127176.545278:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127176.545319:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752692736 00000100:00100000:0.0:1789127176.545323:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752692736 00010000:00010000:0.0:1789127176.545342:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000003b770210/0xeeacf7c024300171 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xeeacf7c02430016a expref: 13 pid: 5822 timeout: 272 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127176.545363:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789127176.545368:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000015b752d8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+13:3300:x1876035752692736:12345-0@lo:103: 00010000:00010000:0.0:1789127176.545391:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789127176.545396:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000003b770210/0xeeacf7c024300171 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xeeacf7c02430016a expref: 13 pid: 5822 timeout: 272 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127176.545405:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000003b770210/0xeeacf7c024300171 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xeeacf7c02430016a expref: 13 pid: 5822 timeout: 272 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127176.545420:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000e122e194/0xeeacf7c0243001a2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127176.545427:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e122e194/0xeeacf7c0243001a2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789127176.545440:0:5815:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001247033s 00010000:00010000:0.0:1789127176.545443:0:5815:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e122e194/0xeeacf7c0243001a2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127176.545448:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e122e194/0xeeacf7c0243001a2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127176.545453:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000e122e194/0xeeacf7c0243001a2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127176.545458:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000e122e194/0xeeacf7c0243001a2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127176.545462:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e122e194 already unused, calling callback (000000009f7ec753) 00010000:00010000:0.0:1789127176.545465:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000e122e194/0xeeacf7c0243001a2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127176.545472:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000e122e194/0xeeacf7c0243001a2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127176.545486:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000e122e194/0xeeacf7c0243001a2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127176.545495:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789127176.545523:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000015b752d8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+13:3300:x1876035752692736:12345-0@lo:103: Request processed in 155us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127176.545530:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789127176.545563:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000095dd62b2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3300:1876035752692736:0@lo:103: 00010000:00010000:0.0:1789127176.545591:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003b770210/0xeeacf7c024300171 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xeeacf7c02430016a expref: 12 pid: 5822 timeout: 272 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127176.545601:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000002e20520 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5846:1876035752692608:0@lo:104: 00010000:00010000:0.0:1789127176.545611:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000e122e194/0xeeacf7c0243001a2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127176.545618:0:5846:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000e122e194/0xeeacf7c0243001a2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127176.545622:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000e122e194/0xeeacf7c0243001a2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127176.545627:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e122e194/0xeeacf7c0243001a2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127176.556328:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000758cd260 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+11:5811:x1876035752692480:12345-0@lo:253: Request processed in 32257us (32393us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127176.556344:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789127176.556423:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000060fa91f3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5811:1876035752692480:0@lo:253: 10000000:01000000:2.0:1789127176.556439:0:5811:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1789127176.556441:0:5811:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789127176.556443:0:5811:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789127176.556445:0:5811:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789127176.556446:0:5811:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789127176.556447:0:5811:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789127176.556449:0:5811:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789127176.556449:0:5811:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789127176.556451:0:5811:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789127176.556452:0:5811:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789127176.556454:0:5811:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789127176.556455:0:5811:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789127176.556457:0:5811:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789127176.556471:0:5811:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1789127176.562406:0:5811:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1789127176.562658:0:5811:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1789127176.564369:0:5811:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1789127176.564551:0:5811:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1789127176.564895:0:5811:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1789127176.565100:0:5811:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1789127176.567026:0:5811:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1789127176.567244:0:5811:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1789127176.567473:0:5811:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1789127176.567638:0:5811:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1789127176.568271:0:5811:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1789127176.568445:0:5811:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:1.0:1789127176.617756:0:5811:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00010000:00010000:1.0:1789127176.627134:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1789127176.653335:0:5811:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:0.0:1789127176.653723:0:5864:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1789127176.656532:0:5811:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1789127176.656715:0:5811:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1789127176.657171:0:5811:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1789127176.657178:0:5811:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000020:00080000:1.0:1789127176.657600:0:5863:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1789127176.657605:0:5863:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:00080000:2.0:1789127176.658302:0:5811:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789127176.659539:0:5811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1789127176.660162:0:5811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1789127176.660200:0:5811:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1789127176.660454:0:5811:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1789127176.661065:0:5811:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:2.0:1789127176.663160:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1789127176.663315:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1789127176.663461:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1789127176.663611:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1789127176.663769:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1789127176.663988:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1789127176.664120:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1789127176.664288:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1789127176.664435:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1789127176.664584:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1789127176.664720:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1789127176.664978:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1789127176.665371:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1789127176.665535:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1789127176.665675:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1789127176.666059:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1789127176.666343:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1789127176.666503:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1789127176.666635:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1789127176.666975:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1789127176.667117:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1789127176.667265:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1789127176.667396:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1789127176.667546:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1789127176.667730:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1789127176.670525:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1789127176.670688:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1789127176.671141:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1789127176.671346:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1789127176.671499:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1789127176.671635:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1789127176.671941:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1789127176.672146:0:5811:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:0.0:1789127176.699090:0:5864:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789127176.750956:0:5864:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789127176.751038:0:5864:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1789127176.751043:0:5864:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:00080000:3.0:1789127176.751472:0:5811:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1789127176.751498:0:5811:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa7e041dbf988 00100000:10000000:3.0:1789127176.751505:0:5811:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1789127176.754029:0:5811:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789127176.754045:0:5811:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.140@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789127176.754058:0:5811:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1789127176.754073:0:5811:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:2.0:1789127177.650957:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127178.678985:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127179.703412:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127180.726420:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789127181.480391:0:6106:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789127181.751062:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789127181.812172:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789127181.812182:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789127181.812186:0:37:0:(import.c:65:import_set_state_nolock()) 000000008308fe15 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789127181.812198:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000008308fe15 using connection 192.168.206.140@tcp/0@lo 00000100:00100000:1.0:1789127181.812231:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000e674ee74 x1876035752692992/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789127181.812262:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e674ee74 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876035752692992:0@lo:38: 00000100:00100000:1.0:1789127181.812330:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127181.812512:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008864290b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3302:1876035752692864:0@lo:400: 00000100:00100000:3.0:1789127181.812542:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127181.812613:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752692864 00000100:00100000:1.0:1789127181.812619:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752692864 00000100:00100000:1.0:1789127181.812662:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789127181.812669:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e542ee02 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+11:3302:x1876035752692864:12345-0@lo:400: 00000100:00100000:1.0:1789127181.812713:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e542ee02 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+11:3302:x1876035752692864:12345-0@lo:400: Request processed in 44us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127181.812720:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789127181.812879:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008864290b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3302:1876035752692864:0@lo:400: 00000100:00100000:2.0:1789127181.812990:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752692992 00000100:00100000:2.0:1789127181.812995:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752692992 00000100:00100000:2.0:1789127181.813021:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789127181.813025:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000910553ac pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3299:x1876035752692992:12345-0@lo:38: 00010000:00080000:2.0:1789127181.813043:0:5832:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 127 last 0 00000020:00000080:2.0:1789127181.813078:0:5832:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xeeacf7c0243001a9 00000004:00100000:2.0:1789127181.813119:0:5832:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789127181.813215:0:5832:0:(import.c:65:import_set_state_nolock()) 00000000791f444a : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789127181.813257:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000910553ac pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876035752692992:12345-0@lo:38: Request processed in 231us (927us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127181.813263:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789127181.813341:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000e674ee74 x1876035752692992/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789127191 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789127181.813354:0:3299:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1789127181.813360:0:3299:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1789127181.813364:0:3299:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789127181.813366:0:3299:0:(import.c:65:import_set_state_nolock()) 000000008308fe15 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789127181.813370:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e674ee74 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876035752692992:0@lo:38: 10000000:01000000:1.0:1789127182.328821:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789127182.328829:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8df788820800 from 3 10000000:01000000:1.0:1789127182.328834:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789127182.328875:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: 0000000063b3bbfd/0xeeacf7c0243001b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127182.328887:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: 0000000063b3bbfd/0xeeacf7c0243001b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127182.328909:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: 0000000063b3bbfd/0xeeacf7c0243001b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127182.328933:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a1bd6125 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752693120:0@lo:101: 00000100:00100000:1.0:1789127182.329000:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127182.329045:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c2f33dea going to sleep for 11 seconds 00000100:00100000:1.0:1789127182.329066:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752693120 00000100:00100000:1.0:1789127182.329073:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752693120 00000100:00100000:1.0:1789127182.329130:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789127182.329138:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000098f96792 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+11:5827:x1876035752693120:12345-0@lo:101: 00010000:00010000:1.0:1789127182.329151:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127182.329163:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009c62053f/0xeeacf7c0243001b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xeeacf7c0243001b0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127182.329184:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009c62053f/0xeeacf7c0243001b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xeeacf7c0243001b0 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127182.329193:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009c62053f/0xeeacf7c0243001b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c0243001b0 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127182.329200:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009c62053f, rc 0) 00000100:00100000:1.0:1789127182.329235:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000098f96792 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+12:5827:x1876035752693120:12345-0@lo:101: Request processed in 98us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127182.329242:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789127182.329287:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a1bd6125 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752693120:0@lo:101: 00010000:00010000:1.0:1789127182.329301:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: 0000000063b3bbfd/0xeeacf7c0243001b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c0243001b7 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127182.329318:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: 0000000063b3bbfd/0xeeacf7c0243001b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xeeacf7c0243001b7 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127182.329362:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a1bd6125 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752693248:0@lo:256: 00000100:00100000:1.0:1789127182.329389:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127182.329410:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c2f33dea going to sleep for 11 seconds 00000100:00100000:3.0:1789127182.329415:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752693248 00000100:00100000:3.0:1789127182.329419:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752693248 00000100:00100000:3.0:1789127182.329567:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789127182.329574:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000052a088e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+12:5827:x1876035752693248:12345-0@lo:256: 20000000:01000000:3.0:1789127182.329589:0:5825:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789127182.329602:0:5825:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789127182.329605:0:5825:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1789127182.330164:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000052a088e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+12:5827:x1876035752693248:12345-0@lo:256: Request processed in 589us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127182.330179:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789127182.330216:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a1bd6125 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752693248:0@lo:256: 10000000:01000000:3.0:1789127182.330254:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789127182.330260:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: 0000000063b3bbfd/0xeeacf7c0243001b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c0243001b7 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127182.330267:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: 0000000063b3bbfd/0xeeacf7c0243001b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c0243001b7 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127182.774131:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127183.795726:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127184.819053:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127185.842997:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789127186.454656:0:6308:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffce7e1b50 20000000:00000080:1.0:1789127186.454681:0:6308:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8df7b402f000 uarg=0000000000000000 20000000:01000000:1.0:1789127186.454739:0:6308:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1789127186.454747:0:6308:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1789127186.454753:0:6308:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1789127186.456940:0:6308:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1789127186.456960:0:6308:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:1.0:1789127186.466224:0:6308:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789127186.469943:0:6308:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1789127186.470025:0:6308:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:1.0:1789127186.470074:0:6308:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:1.0:1789127186.470096:0:6308:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789127186.470136:0:6308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000005bab87b6/0xeeacf7c0243001be lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127186.470160:0:6308:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000d9720fc5/0xeeacf7c02430017f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c024300178 expref: 11 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127186.470167:0:6308:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000005bab87b6/0xeeacf7c0243001be lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127186.470228:0:6308:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000d9720fc5/0xeeacf7c02430017f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xeeacf7c024300178 expref: 11 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127186.470247:0:6308:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000d9720fc5/0xeeacf7c02430017f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xeeacf7c024300178 expref: 11 pid: 5825 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127186.470264:0:6308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000006c6dcde pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6308:1876035752693376:0@lo:104: 00000100:00100000:1.0:1789127186.470355:0:6308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127186.470432:0:6308:0:(client.c:2715:ptlrpc_set_wait()) set 00000000da49d896 going to sleep for 11 seconds 00000100:00100000:2.0:1789127186.470452:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752693376 00000100:00100000:2.0:1789127186.470644:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752693376 00000100:00100000:2.0:1789127186.471128:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789127186.471139:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b311096a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+3:6308:x1876035752693376:12345-0@lo:104: 00010000:00010000:2.0:1789127186.471156:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.140@tcp lock: 00000000eebfa228/0xeeacf7c024300178 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xeeacf7c02430017f expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127186.471304:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789127186.471309:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b311096a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+3:6308:x1876035752693376:12345-0@lo:104: Request processed in 174us (957us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127186.471316:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1789127186.471341:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789127186.471346:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.140@tcp lock: 00000000eebfa228/0xeeacf7c024300178 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xeeacf7c02430017f expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127186.471368:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000eebfa228 already unused, calling callback (00000000eaae6637) 10000000:00010000:2.0:1789127186.471371:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.140@tcp lock: 00000000eebfa228/0xeeacf7c024300178 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xeeacf7c02430017f expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127186.471378:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: 00000000eebfa228/0xeeacf7c024300178 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xeeacf7c02430017f expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789127186.471383:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: 00000000eebfa228/0xeeacf7c024300178 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xeeacf7c02430017f expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127186.471388:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789127186.471657:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.140@tcp lock: 00000000eebfa228/0xeeacf7c024300178 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c02430017f expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127186.471665:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789127186.471696:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.140@tcp lock: 00000000eebfa228/0xeeacf7c024300178 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c02430017f expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127186.471703:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: 00000000eebfa228/0xeeacf7c024300178 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c02430017f expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127186.471717:0:6308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000006c6dcde pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6308:1876035752693376:0@lo:104: 00010000:00010000:3.0:1789127186.471760:0:6308:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000005bab87b6/0xeeacf7c0243001be lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127186.471839:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127186.471841:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127186.471843:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127186.471861:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789127186.471881:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d32e642f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3302:1876035752693504:0@lo:103: 00000100:00100000:3.0:1789127186.471945:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127186.472087:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752693504 00000100:00100000:2.0:1789127186.472095:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752693504 00010000:00010000:2.0:1789127186.472123:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000d9720fc5/0xeeacf7c02430017f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xeeacf7c024300178 expref: 12 pid: 5825 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127186.472156:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789127186.472544:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b1e294e8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+12:3302:x1876035752693504:12345-0@lo:103: 00010000:00010000:2.0:1789127186.472687:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789127186.472694:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000d9720fc5/0xeeacf7c02430017f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xeeacf7c024300178 expref: 12 pid: 5825 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127186.473084:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000d9720fc5/0xeeacf7c02430017f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xeeacf7c024300178 expref: 12 pid: 5825 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127186.473105:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d9720fc5/0xeeacf7c02430017f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xeeacf7c024300178 expref: 12 pid: 5825 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127186.473122:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000005bab87b6/0xeeacf7c0243001be lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127186.473130:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005bab87b6/0xeeacf7c0243001be lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127186.473148:0:5815:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000005bab87b6/0xeeacf7c0243001be lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127186.473155:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000005bab87b6/0xeeacf7c0243001be lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127186.473161:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000005bab87b6/0xeeacf7c0243001be lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127186.473241:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000005bab87b6/0xeeacf7c0243001be lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127186.473249:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005bab87b6 already unused, calling callback (000000009f7ec753) 00010000:00010000:2.0:1789127186.473252:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000005bab87b6/0xeeacf7c0243001be lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127186.473272:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000005bab87b6/0xeeacf7c0243001be lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127186.473293:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000005bab87b6/0xeeacf7c0243001be lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127186.473305:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789127186.473385:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b1e294e8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+11:3302:x1876035752693504:12345-0@lo:103: Request processed in 848us (1439us total) trans 0 rc 0/0 00010000:00010000:3.0:1789127186.473688:0:6308:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000005bab87b6/0xeeacf7c0243001be lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127186.473715:0:6308:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000005bab87b6/0xeeacf7c0243001be lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127186.473733:0:6308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005bab87b6/0xeeacf7c0243001be lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127186.474091:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789127186.474895:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d32e642f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3302:1876035752693504:0@lo:103: 00010000:00010000:1.0:1789127186.867099:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127186.931277:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000042145f9d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3300:1876035752693632:0@lo:400: 00000100:00100000:0.0:1789127186.931393:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127186.931476:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789127186.931482:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001e8e4c97 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876035752693760:0@lo:400: 00000100:00100000:0.0:1789127186.931513:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127186.931561:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752693760 00000100:00100000:0.0:1789127186.931569:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752693760 00000100:00100000:0.0:1789127186.931622:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789127186.931632:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a6f93563 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876035752693760:12345-0@lo:400: 00000100:00100000:0.0:1789127186.931691:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a6f93563 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876035752693760:12345-0@lo:400: Request processed in 61us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127186.931699:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789127186.931751:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000001e8e4c97 x1876035752693760/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127202 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127186.931766:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001e8e4c97 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876035752693760:0@lo:400: 00000100:00100000:3.0:1789127186.934272:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752693632 00000100:00100000:3.0:1789127186.934289:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752693632 00000100:00100000:3.0:1789127186.934382:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789127186.934415:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000074fe32 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+11:3300:x1876035752693632:12345-0@lo:400: 00000100:00100000:3.0:1789127186.934539:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000074fe32 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+11:3300:x1876035752693632:12345-0@lo:400: Request processed in 126us (3147us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127186.934547:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789127186.934726:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000042145f9d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3300:1876035752693632:0@lo:400: 00010000:00010000:3.0:1789127187.903662:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127188.917087:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127189.938948:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789127190.259985:0:5827:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789127190.259994:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df788820800 from 1 10000000:01000000:1.0:1789127190.259999:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789127190.260039:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: 000000004cc7d5e6/0xeeacf7c0243001c5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127190.260051:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: 000000004cc7d5e6/0xeeacf7c0243001c5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127190.260061:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: 000000004cc7d5e6/0xeeacf7c0243001c5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127190.260083:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e674ee74 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752693888:0@lo:101: 00000100:00100000:1.0:1789127190.260151:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127190.260199:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set 0000000088350cb1 going to sleep for 11 seconds 00000100:00100000:2.0:1789127190.261994:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752693888 00000100:00100000:2.0:1789127190.262006:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752693888 00000100:00100000:2.0:1789127190.262061:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789127190.262069:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000da76a1a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+11:5827:x1876035752693888:12345-0@lo:101: 00010000:00010000:2.0:1789127190.262083:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127190.262099:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004ee31f09/0xeeacf7c0243001cc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xeeacf7c0243001c5 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127190.262123:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004ee31f09/0xeeacf7c0243001cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xeeacf7c0243001c5 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127190.262133:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004ee31f09/0xeeacf7c0243001cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c0243001c5 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127190.262141:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004ee31f09, rc 0) 00000100:00100000:2.0:1789127190.262206:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000da76a1a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+12:5827:x1876035752693888:12345-0@lo:101: Request processed in 136us (2053us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127190.262212:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789127190.262286:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e674ee74 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752693888:0@lo:101: 00010000:00010000:2.0:1789127190.262303:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: 000000004cc7d5e6/0xeeacf7c0243001c5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c0243001cc expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127190.262312:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: 000000004cc7d5e6/0xeeacf7c0243001c5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xeeacf7c0243001cc expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127190.262374:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cb318a21 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752694016:0@lo:501: 00000100:00100000:2.0:1789127190.262403:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127190.262428:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e3a3192e going to sleep for 11 seconds 00000100:00100000:2.0:1789127190.262440:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752694016 00000100:00100000:2.0:1789127190.262443:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752694016 00000100:00100000:2.0:1789127190.262461:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789127190.262466:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000340b7549 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+12:5827:x1876035752694016:12345-0@lo:501: 00000100:00100000:2.0:1789127190.263441:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000340b7549 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+12:5827:x1876035752694016:12345-0@lo:501: Request processed in 971us (1034us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127190.263449:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789127190.263492:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cb318a21 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752694016:0@lo:501: 00000100:00100000:2.0:1789127190.267480:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cb318a21 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752694144:0@lo:503: 00000100:00100000:2.0:1789127190.267569:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127190.267614:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e3a3192e going to sleep for 11 seconds 00000100:00100000:2.0:1789127190.267643:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752694144 00000100:00100000:2.0:1789127190.267649:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752694144 00000100:00100000:2.0:1789127190.267695:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789127190.267713:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b38a4427 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+12:5827:x1876035752694144:12345-0@lo:503: 00000100:00100000:2.0:1789127190.271315:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b38a4427 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+12:5827:x1876035752694144:12345-0@lo:503: Request processed in 3598us (3740us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127190.271340:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789127190.272695:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cb318a21 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752694144:0@lo:503: 00000100:00100000:1.0:1789127190.273261:0:6570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a1bd6125 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:6570:1876035752694272:0@lo:502: 00000100:00100000:1.0:1789127190.273325:0:6570:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127190.273367:0:6570:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d8385c43 going to sleep for 11 seconds 00000100:00100000:2.0:1789127190.273612:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752694272 00000100:00100000:2.0:1789127190.273619:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752694272 00000100:00100000:2.0:1789127190.273673:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789127190.273682:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002da6af25 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+12:6570:x1876035752694272:12345-0@lo:502: 00000100:00100000:2.0:1789127190.274098:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002da6af25 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+12:6570:x1876035752694272:12345-0@lo:502: Request processed in 416us (772us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127190.274106:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789127190.275770:0:6570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a1bd6125 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:6570:1876035752694272:0@lo:502: 00000020:01000000:1.0:1789127190.275825:0:6570:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789127190.275835:0:6570:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127190.275838:0:6570:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789127190.275846:0:6570:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8df788820800 00000020:00000080:1.0:1789127190.275848:0:6570:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789127190.275899:0:6570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a3a0b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:6570:1876035752694400:0@lo:502: 00000100:00100000:1.0:1789127190.275971:0:6570:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127190.276015:0:6570:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df790cd1300 going to sleep for 11 seconds 00000100:00100000:3.0:1789127190.277128:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752694400 00000100:00100000:3.0:1789127190.277139:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752694400 00000100:00100000:3.0:1789127190.279243:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789127190.279261:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7906cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+12:6570:x1876035752694400:12345-0@lo:502: 00000100:00100000:3.0:1789127190.279695:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7906cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+12:6570:x1876035752694400:12345-0@lo:502: Request processed in 439us (3723us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127190.279716:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789127190.279785:0:6570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a3a0b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:6570:1876035752694400:0@lo:502: 00000020:01000000:1.0:1789127190.279843:0:6570:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789127190.279851:0:6570:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127190.279853:0:6570:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1789127190.279860:0:6570:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1789127190.281075:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1789127190.281101:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789127190.281111:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df7c2050c00/0xeeacf7c0243001c5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c0243001cc expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127190.281123:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff8df7c2050c00/0xeeacf7c0243001c5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c0243001cc expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127190.966048:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127191.986972:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127192.051059:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a2c5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876035752694656:0@lo:400: 00000100:00100000:1.0:1789127192.051128:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127192.051182:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789127192.051188:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a2c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3303:1876035752694528:0@lo:400: 00000100:00100000:1.0:1789127192.051216:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127192.051591:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752694656 00000100:00100000:3.0:1789127192.051599:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752694656 00000100:00100000:3.0:1789127192.051656:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789127192.051674:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79a3a3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876035752694656:12345-0@lo:400: 00000100:00100000:3.0:1789127192.051743:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79a3a3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876035752694656:12345-0@lo:400: Request processed in 70us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127192.051751:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789127192.051817:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8df79a2c5e00 x1876035752694656/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127208 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127192.051830:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a2c5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876035752694656:0@lo:400: 00000100:00100000:0.0:1789127192.052027:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752694528 00000100:00100000:0.0:1789127192.052032:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752694528 00000100:00100000:0.0:1789127192.052068:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789127192.052076:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7906ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+12:3303:x1876035752694528:12345-0@lo:400: 00000100:00100000:0.0:1789127192.052119:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7906ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+12:3303:x1876035752694528:12345-0@lo:400: Request processed in 43us (901us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127192.052125:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789127192.052157:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a2c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3303:1876035752694528:0@lo:400: 00000020:01000004:2.0:1789127192.559731:0:6685:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789127192.559746:0:6685:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1789127192.559920:0:6685:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8df788896800 00000020:01000004:2.0:1789127192.559937:0:6685:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1789127192.559948:0:6685:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1789127192.559971:0:6685:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8df790233490) 00000020:00000080:2.0:1789127192.559988:0:6685:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1789127192.591551:0:6685:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1789127192.592111:0:6685:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1789127192.629546:0:6685:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1789127192.638038:0:6685:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1789127192.638089:0:6685:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1789127192.638151:0:6685:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1789127192.638181:0:6685:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1789127192.638536:0:6685:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1789127192.638547:0:6685:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789127192.638557:0:6685:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xeeacf7c0243001da 00000020:01000004:3.0:1789127192.638566:0:6685:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1789127192.638589:0:6685:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.140@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789127192.638592:0:6685:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.140@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789127192.638599:0:6685:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1789127192.638604:0:6685:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1789127192.638616:0:6685:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8df7881db490) 00000020:00000080:3.0:1789127192.638627:0:6685:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:3.0:1789127192.640213:0:6685:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789127192.640451:0:6685:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1789127192.640457:0:6685:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1789127192.648136:0:6685:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1789127192.648151:0:6685:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1789127192.648575:0:6685:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1789127192.648581:0:6685:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1789127192.651229:0:6685:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789127192.651408:0:6685:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1789127192.651415:0:6685:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1789127192.654001:0:6685:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1789127192.654015:0:6685:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1789127192.702495:0:6685:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789127192.702754:0:6685:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789127192.702761:0:6685:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1789127192.705180:0:6685:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789127192.705194:0:6685:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1789127192.708454:0:6685:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1789127192.708471:0:6685:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1789127192.713709:0:6685:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789127192.714242:0:6685:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1789127192.714257:0:6685:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1789127192.716619:0:6685:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1789127192.716631:0:6685:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1789127192.792107:0:6685:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789127192.792312:0:6685:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1789127192.792319:0:6685:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1789127192.796206:0:6685:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1789127192.796226:0:6685:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1789127192.796926:0:6685:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1789127192.796957:0:6685:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1789127192.796963:0:6685:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.140@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1789127192.831849:0:6685:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.140@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789127192.831894:0:6685:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.140@tcp, index=0000, flags=0x20062 00000020:01000004:1.0:1789127192.831898:0:6685:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789127192.831900:0:6685:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789127192.831901:0:6685:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789127192.831902:0:6685:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789127192.831903:0:6685:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789127192.831905:0:6685:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789127192.831906:0:6685:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789127192.831908:0:6685:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789127192.831909:0:6685:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789127192.831911:0:6685:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789127192.831913:0:6685:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789127192.831916:0:6685:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:1.0:1789127192.831918:0:6685:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789127192.831919:0:6685:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789127192.831920:0:6685:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789127192.831922:0:6685:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789127192.831923:0:6685:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789127192.831924:0:6685:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789127192.831925:0:6685:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789127192.831926:0:6685:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789127192.831927:0:6685:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789127192.831928:0:6685:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789127192.831929:0:6685:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789127192.831957:0:6685:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1789127192.831977:0:6685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a3a03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:6685:1876035752694784:0@lo:253: 00000100:00100000:1.0:1789127192.832048:0:6685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127192.832222:0:6685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df78802a840 going to sleep for 11 seconds 00000100:00100000:3.0:1789127192.833456:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752694784 00000100:00100000:3.0:1789127192.833467:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752694784 00000100:00100000:3.0:1789127192.833532:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789127192.833542:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7906c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+12:6685:x1876035752694784:12345-0@lo:253: 20000000:01000000:3.0:1789127192.833593:0:5825:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1789127192.833597:0:5825:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:3.0:1789127192.833603:0:5825:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:3.0:1789127192.833606:0:5825:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:3.0:1789127192.838126:0:5825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789127192.838376:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:3.0:1789127192.838392:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:3.0:1789127192.838430:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:3.0:1789127192.838437:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:3.0:1789127192.838466:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:3.0:1789127192.838524:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:2.0:1789127192.842902:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1789127192.842938:0:5825:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.140@tcp 20000000:01000000:2.0:1789127192.842941:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.140@tcp (null) (null) (null) 00000040:00080000:2.0:1789127192.842981:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1789127192.842990:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1789127192.843056:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1789127192.843069:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.206.140@tcp (null) (null) 00000040:00080000:2.0:1789127192.843101:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1789127192.843111:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1789127192.843169:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1789127192.843247:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:2.0:1789127192.844408:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:2.0:1789127192.844433:0:5825:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.140@tcp 20000000:01000000:2.0:1789127192.844436:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.140@tcp (null) (null) (null) 00000040:00080000:2.0:1789127192.844475:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:2.0:1789127192.844482:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1789127192.844513:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:2.0:1789127192.844520:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.206.140@tcp (null) (null) 00000040:00080000:2.0:1789127192.844567:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:2.0:1789127192.844576:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1789127192.844605:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:2.0:1789127192.844637:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:2.0:1789127192.844653:0:5825:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:2.0:1789127192.844878:0:5825:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:2.0:1789127192.844883:0:5825:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1789127192.844885:0:5825:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1789127192.844887:0:5825:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1789127192.844900:0:5825:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1789127192.844903:0:5825:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1789127192.844949:0:5825:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1789127192.844951:0:5825:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789127192.846935:0:6699:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:2.0:1789127192.847014:0:6699:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:2.0:1789127192.847067:0:6699:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1789127192.848294:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:0.0:1789127192.848360:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:0.0:1789127192.848398:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:0.0:1789127192.848411:0:5825:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1789127192.848413:0:5825:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1789127192.849132:0:6700:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1789127192.849447:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:0.0:1789127192.849488:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:0.0:1789127192.849547:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:0.0:1789127192.849559:0:5825:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1789127192.849562:0:5825:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789127192.851404:0:6701:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 10 1->4: lustre sys.timeout 20000000:01000000:0.0:1789127192.851503:0:6701:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 10 2->4: lustre sys.timeout 00000040:00080000:0.0:1789127192.851568:0:6701:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1789127192.852007:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1789127192.852055:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1789127192.852125:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 10000000:01000000:2.0:1789127192.852142:0:5825:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789127192.852161:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8df7c2172600/0xeeacf7c0243001e8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127192.852185:0:5825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df7c2051200/0xeeacf7c024300101 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c0243000fa expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127192.852195:0:5825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df7c2050a00/0xeeacf7c02430011d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c024300116 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127192.852202:0:5825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df7c2173e00/0xeeacf7c02430018d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c024300186 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127192.852212:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8df7c2172600/0xeeacf7c0243001e8 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127192.852251:0:5825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df7c2173e00/0xeeacf7c02430018d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xeeacf7c024300186 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127192.852269:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df7c2173e00/0xeeacf7c02430018d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xeeacf7c024300186 expref: 12 pid: 5825 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127192.852284:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a3870c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5825:1876035752694912:0@lo:104: 00000100:00100000:2.0:1789127192.852357:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789127192.852431:0:5825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df7c2050a00/0xeeacf7c02430011d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xeeacf7c024300116 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127192.852443:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df7c2050a00/0xeeacf7c02430011d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xeeacf7c024300116 expref: 12 pid: 5824 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127192.852456:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a387480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5825:1876035752695040:0@lo:104: 00000100:00100000:2.0:1789127192.852485:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789127192.852517:0:5825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df7c2051200/0xeeacf7c024300101 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xeeacf7c0243000fa expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127192.852525:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df7c2051200/0xeeacf7c024300101 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xeeacf7c0243000fa expref: 12 pid: 5824 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127192.852536:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a384780 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5825:1876035752695168:0@lo:104: 00000100:00100000:2.0:1789127192.852561:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127192.852570:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df78efaf780 going to sleep for 11 seconds 00000100:00100000:3.0:1789127192.852666:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752694912 00000100:00100000:3.0:1789127192.852672:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752694912 00000100:00100000:3.0:1789127192.852720:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752695040 00000100:00100000:3.0:1789127192.852724:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752695040 00000100:00100000:3.0:1789127192.852741:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752695168 00000100:00100000:3.0:1789127192.852743:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752695168 00000100:00100000:3.0:1789127192.852761:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789127192.852775:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79a3861c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+5:5825:x1876035752694912:12345-0@lo:104: 00010000:00010000:3.0:1789127192.852816:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.140@tcp lock: ffff8df7c2051e00/0xeeacf7c024300186 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xeeacf7c02430018d expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127192.852884:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789127192.852890:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79a3861c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+5:5825:x1876035752694912:12345-0@lo:104: Request processed in 122us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127192.852897:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789127192.852912:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789127192.852918:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79a3852c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+4:5825:x1876035752695040:12345-0@lo:104: 00010000:00010000:3.0:1789127192.852926:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.140@tcp lock: ffff8df780031600/0xeeacf7c024300116 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xeeacf7c02430011d expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127192.852959:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789127192.852964:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79a3852c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+4:5825:x1876035752695040:12345-0@lo:104: Request processed in 47us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127192.852970:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789127192.852981:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789127192.852986:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79a386580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+3:5825:x1876035752695168:12345-0@lo:104: 00010000:00010000:3.0:1789127192.852993:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.140@tcp lock: ffff8df798df1c00/0xeeacf7c0243000fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xeeacf7c024300101 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127192.853034:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789127192.853042:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79a386580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+3:5825:x1876035752695168:12345-0@lo:104: Request processed in 57us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127192.853048:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1789127192.853074:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789127192.853080:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.140@tcp lock: ffff8df7c2051e00/0xeeacf7c024300186 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xeeacf7c02430018d expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127192.853087:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7c2051e00 already unused, calling callback (ffffffffc1da1c20) 10000000:00010000:3.0:1789127192.853094:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.140@tcp lock: ffff8df7c2051e00/0xeeacf7c024300186 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xeeacf7c02430018d expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127192.853103:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: ffff8df7c2051e00/0xeeacf7c024300186 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xeeacf7c02430018d expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789127192.853110:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: ffff8df7c2051e00/0xeeacf7c024300186 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xeeacf7c02430018d expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127192.853116:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789127192.853145:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.140@tcp lock: ffff8df7c2051e00/0xeeacf7c024300186 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c02430018d expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127192.853152:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789127192.853170:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.140@tcp lock: ffff8df7c2051e00/0xeeacf7c024300186 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c02430018d expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127192.853177:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: ffff8df7c2051e00/0xeeacf7c024300186 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c02430018d expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127192.853201:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789127192.853205:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.140@tcp lock: ffff8df780031600/0xeeacf7c024300116 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xeeacf7c02430011d expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127192.853210:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df780031600 already unused, calling callback (ffffffffc1da1c20) 10000000:00010000:3.0:1789127192.853213:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.140@tcp lock: ffff8df780031600/0xeeacf7c024300116 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xeeacf7c02430011d expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127192.853219:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: ffff8df780031600/0xeeacf7c024300116 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xeeacf7c02430011d expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789127192.853225:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: ffff8df780031600/0xeeacf7c024300116 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xeeacf7c02430011d expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127192.853230:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789127192.853244:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.140@tcp lock: ffff8df780031600/0xeeacf7c024300116 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c02430011d expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127192.853250:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789127192.853255:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.140@tcp lock: ffff8df780031600/0xeeacf7c024300116 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c02430011d expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127192.853260:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: ffff8df780031600/0xeeacf7c024300116 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c02430011d expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127192.853268:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789127192.853271:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.140@tcp lock: ffff8df798df1c00/0xeeacf7c0243000fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xeeacf7c024300101 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127192.853285:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df798df1c00 already unused, calling callback (ffffffffc1da1c20) 10000000:00010000:3.0:1789127192.853288:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.140@tcp lock: ffff8df798df1c00/0xeeacf7c0243000fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xeeacf7c024300101 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127192.853295:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: ffff8df798df1c00/0xeeacf7c0243000fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xeeacf7c024300101 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789127192.853301:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: ffff8df798df1c00/0xeeacf7c0243000fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xeeacf7c024300101 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127192.853306:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789127192.853318:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.140@tcp lock: ffff8df798df1c00/0xeeacf7c0243000fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c024300101 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127192.853324:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789127192.853338:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.140@tcp lock: ffff8df798df1c00/0xeeacf7c0243000fa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c024300101 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127192.853344:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: ffff8df798df1c00/0xeeacf7c0243000fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c024300101 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127192.853358:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127192.853360:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127192.853361:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127192.853382:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a2c5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3300:1876035752695296:0@lo:103: 00000100:00100000:3.0:1789127192.853411:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127192.853437:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789127192.853442:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a2c43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3300:1876035752695424:0@lo:103: 00000100:00100000:3.0:1789127192.853472:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127192.853507:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a2c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3302:1876035752695552:0@lo:103: 00000100:00100000:3.0:1789127192.853529:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127192.853567:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752695296 00000100:00100000:3.0:1789127192.853572:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752695296 00010000:00010000:3.0:1789127192.853604:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df7c2173e00/0xeeacf7c02430018d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xeeacf7c024300186 expref: 13 pid: 5825 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127192.853619:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752695424 00000100:00100000:3.0:1789127192.853622:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752695424 00010000:00010000:3.0:1789127192.853634:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df7c2050a00/0xeeacf7c02430011d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xeeacf7c024300116 expref: 14 pid: 5824 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127192.853643:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752695552 00000100:00100000:3.0:1789127192.853647:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752695552 00010000:00010000:3.0:1789127192.853655:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df7c2051200/0xeeacf7c024300101 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xeeacf7c0243000fa expref: 15 pid: 5824 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127192.853665:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789127192.853670:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79a2c5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+15:3300:x1876035752695296:12345-0@lo:103: 00010000:00010000:3.0:1789127192.853700:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127192.853706:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df7c2173e00/0xeeacf7c02430018d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xeeacf7c024300186 expref: 15 pid: 5825 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127192.853715:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df7c2173e00/0xeeacf7c02430018d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xeeacf7c024300186 expref: 15 pid: 5825 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127192.853729:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127192.853757:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79a2c5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+15:3300:x1876035752695296:12345-0@lo:103: Request processed in 86us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127192.853779:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789127192.853813:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789127192.853820:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79a2c5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+14:3300:x1876035752695424:12345-0@lo:103: 00010000:00010000:3.0:1789127192.853828:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127192.853833:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df7c2050a00/0xeeacf7c02430011d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xeeacf7c024300116 expref: 14 pid: 5824 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127192.853841:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df7c2050a00/0xeeacf7c02430011d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xeeacf7c024300116 expref: 14 pid: 5824 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127192.853851:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127192.853872:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79a2c5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+14:3300:x1876035752695424:12345-0@lo:103: Request processed in 53us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127192.853878:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789127192.853889:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789127192.853895:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79a2c52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+13:3302:x1876035752695552:12345-0@lo:103: 00010000:00010000:3.0:1789127192.853902:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127192.853905:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df7c2051200/0xeeacf7c024300101 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xeeacf7c0243000fa expref: 13 pid: 5824 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127192.853912:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df7c2051200/0xeeacf7c024300101 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xeeacf7c0243000fa expref: 13 pid: 5824 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127192.853923:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8df7c2172600/0xeeacf7c0243001e8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127192.853931:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df7c2172600/0xeeacf7c0243001e8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127192.853952:0:5816:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df7c2172600/0xeeacf7c0243001e8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127192.853959:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df7c2172600/0xeeacf7c0243001e8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127192.853965:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8df7c2172600/0xeeacf7c0243001e8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127192.853971:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8df7c2172600/0xeeacf7c0243001e8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127192.853976:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7c2172600 already unused, calling callback (ffffffffc17a4550) 00010000:00010000:3.0:1789127192.853980:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8df7c2172600/0xeeacf7c0243001e8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127192.853987:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8df7c2172600/0xeeacf7c0243001e8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127192.853994:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8df7c2172600/0xeeacf7c0243001e8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127192.854002:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127192.854027:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79a2c52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+13:3302:x1876035752695552:12345-0@lo:103: Request processed in 132us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127192.854032:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789127192.854063:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a2c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3302:1876035752695552:0@lo:103: 00000100:00100000:3.0:1789127192.854087:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a2c43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3300:1876035752695424:0@lo:103: 00000100:00100000:3.0:1789127192.854093:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a2c5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3300:1876035752695296:0@lo:103: 00010000:00010000:2.0:1789127192.854553:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df7c2173e00/0xeeacf7c02430018d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xeeacf7c024300186 expref: 12 pid: 5825 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127192.854565:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a3870c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5825:1876035752694912:0@lo:104: 00010000:00010000:2.0:1789127192.854575:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df7c2050a00/0xeeacf7c02430011d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xeeacf7c024300116 expref: 11 pid: 5824 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127192.854583:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a387480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5825:1876035752695040:0@lo:104: 00010000:00010000:2.0:1789127192.854592:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df7c2051200/0xeeacf7c024300101 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xeeacf7c0243000fa expref: 10 pid: 5824 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127192.854599:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a384780 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5825:1876035752695168:0@lo:104: 00010000:00010000:2.0:1789127192.854618:0:5825:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8df7c2172600/0xeeacf7c0243001e8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127192.854634:0:5825:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8df7c2172600/0xeeacf7c0243001e8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127192.854641:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8df7c2172600/0xeeacf7c0243001e8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127192.854646:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df7c2172600/0xeeacf7c0243001e8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789127192.854674:0:5825:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00010000:0.0:1789127192.854880:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127192.891398:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7906c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+9:6685:x1876035752694784:12345-0@lo:253: Request processed in 57850us (59342us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127192.891412:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789127192.891525:0:6685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a3a03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:6685:1876035752694784:0@lo:253: 10000000:01000000:2.0:1789127192.891542:0:6685:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789127192.891545:0:6685:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789127192.891547:0:6685:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789127192.891548:0:6685:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789127192.891550:0:6685:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1789127192.891551:0:6685:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789127192.891553:0:6685:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789127192.891554:0:6685:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789127192.891556:0:6685:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1789127192.891558:0:6685:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789127192.891559:0:6685:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789127192.891580:0:6685:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8df788896800 from lustre-OST0000 10000000:01000000:2.0:1789127192.891604:0:6685:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1789127192.891607:0:6685:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789127192.891614:0:6685:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8df790d38000 local copy 10000000:01000000:2.0:1789127192.891618:0:6685:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789127192.891651:0:6685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df7c2172600/0xeeacf7c0243001ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127192.891675:0:6685:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.140@tcp lock: ffff8df7c2172600/0xeeacf7c0243001ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127192.891713:0:6685:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff8df7c2172600/0xeeacf7c0243001ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127192.891732:0:6685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a384780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:6685:1876035752695680:0@lo:101: 00000100:00100000:2.0:1789127192.891769:0:6685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127192.891891:0:6685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df78efaf180 going to sleep for 11 seconds 00000100:00100000:3.0:1789127192.894125:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752695680 00000100:00100000:3.0:1789127192.894138:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752695680 00000100:00100000:2.0:1789127192.894318:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789127192.894334:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7906ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+9:6685:x1876035752695680:12345-0@lo:101: 00010000:00010000:2.0:1789127192.894351:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127192.894371:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df7c2173e00/0xeeacf7c0243001f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xeeacf7c0243001ef expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127192.894398:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df7c2173e00/0xeeacf7c0243001f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xeeacf7c0243001ef expref: 10 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127192.894408:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df7c2173e00/0xeeacf7c0243001f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c0243001ef expref: 10 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127192.894419:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7c2173e00, rc 0) 00000100:00100000:2.0:1789127192.894497:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7906ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+10:6685:x1876035752695680:12345-0@lo:101: Request processed in 169us (2727us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127192.894504:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789127192.894603:0:6685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a384780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:6685:1876035752695680:0@lo:101: 00010000:00010000:1.0:1789127192.894621:0:6685:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff8df7c2172600/0xeeacf7c0243001ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xeeacf7c0243001f6 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127192.894631:0:6685:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff8df7c2172600/0xeeacf7c0243001ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xeeacf7c0243001f6 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127192.894774:0:6685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a3a1a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:6685:1876035752695808:0@lo:501: 00000100:00100000:1.0:1789127192.894849:0:6685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127192.898844:0:6685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df786b37600 going to sleep for 11 seconds 00000100:00100000:0.0:1789127192.898982:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752695808 00000100:00100000:0.0:1789127192.898992:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752695808 00000100:00100000:0.0:1789127192.899040:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789127192.899065:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7906c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+10:6685:x1876035752695808:12345-0@lo:501: 00000100:00100000:0.0:1789127192.899351:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7906c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+10:6685:x1876035752695808:12345-0@lo:501: Request processed in 287us (4502us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789127192.899360:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789127192.899477:0:6685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a3a1a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:6685:1876035752695808:0@lo:501: 10000000:01000000:1.0:1789127192.899503:0:6685:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.140@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789127192.899534:0:6685:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.140@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789127192.899542:0:6685:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df7c2172600/0xeeacf7c0243001ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xeeacf7c0243001f6 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127192.899552:0:6685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df7c2172600/0xeeacf7c0243001ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xeeacf7c0243001f6 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127192.899560:0:6685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.140@tcp lock: ffff8df7c2172600/0xeeacf7c0243001ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xeeacf7c0243001f6 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127192.899588:0:6685:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789127192.899610:0:6685:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8df788896800 10000000:01000000:1.0:1789127192.899616:0:6685:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789127192.899621:0:6685:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8df790d38000 10000000:01000000:1.0:1789127192.899623:0:6685:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1789127192.899627:0:6685:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8df790d38000 from 1 10000000:01000000:1.0:1789127192.899629:0:6685:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789127192.899669:0:6685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df7c2050e00/0xeeacf7c0243001fd lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127192.899678:0:6685:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff8df7c2050e00/0xeeacf7c0243001fd lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127192.899708:0:6685:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff8df7c2050e00/0xeeacf7c0243001fd lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127192.899727:0:6685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a3a1a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:6685:1876035752695936:0@lo:101: 00000100:00100000:1.0:1789127192.899761:0:6685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127192.899775:0:6685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df786b37cc0 going to sleep for 11 seconds 00010000:00010000:0.0:1789127192.899911:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789127192.899918:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.140@tcp lock: ffff8df7c2172600/0xeeacf7c0243001ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xeeacf7c0243001f6 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127192.899925:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7c2172600 already unused, calling callback (ffffffffc1da1c20) 10000000:00010000:0.0:1789127192.899929:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.140@tcp lock: ffff8df7c2172600/0xeeacf7c0243001ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xeeacf7c0243001f6 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127192.899937:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: ffff8df7c2172600/0xeeacf7c0243001ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xeeacf7c0243001f6 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789127192.899943:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: ffff8df7c2172600/0xeeacf7c0243001ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xeeacf7c0243001f6 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127192.899949:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789127192.899971:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.140@tcp lock: ffff8df7c2172600/0xeeacf7c0243001ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xeeacf7c0243001f6 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127192.899978:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789127192.900009:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.140@tcp lock: ffff8df7c2172600/0xeeacf7c0243001ef lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xeeacf7c0243001f6 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127192.900016:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: ffff8df7c2172600/0xeeacf7c0243001ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xeeacf7c0243001f6 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127192.900031:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127192.900039:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127192.900041:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127192.900052:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752695936 00000100:00100000:0.0:1789127192.900057:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752695936 00000100:00100000:0.0:1789127192.900081:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789127192.900088:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7906cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+10:6685:x1876035752695936:12345-0@lo:101: 00010000:00010000:0.0:1789127192.900098:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127192.900110:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df780030000/0xeeacf7c024300204 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xeeacf7c0243001fd expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127192.900130:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df780030000/0xeeacf7c024300204 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xeeacf7c0243001fd expref: 11 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127192.900140:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df780030000/0xeeacf7c024300204 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c0243001fd expref: 11 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127192.900149:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df780030000, rc 0) 00000100:00100000:0.0:1789127192.900181:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7906cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+11:6685:x1876035752695936:12345-0@lo:101: Request processed in 92us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127192.900187:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789127192.900360:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7af7cd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3303:1876035752696064:0@lo:103: 00000100:00100000:1.0:1789127192.900392:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127192.900460:0:6685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a3a1a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:6685:1876035752695936:0@lo:101: 00010000:00010000:1.0:1789127192.900473:0:6685:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff8df7c2050e00/0xeeacf7c0243001fd lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c024300204 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127192.900482:0:6685:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff8df7c2050e00/0xeeacf7c0243001fd lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xeeacf7c024300204 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789127192.900499:0:6685:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789127192.900508:0:6685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df7c2050e00/0xeeacf7c0243001fd lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c024300204 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127192.900515:0:6685:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff8df7c2050e00/0xeeacf7c0243001fd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c024300204 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789127192.900521:0:6685:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1789127192.900525:0:6685:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789127192.900529:0:6685:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1789127192.900532:0:6685:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1789127192.900548:0:6685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df7c2051200/0xeeacf7c02430020b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127192.900561:0:6685:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff8df7c2051200/0xeeacf7c02430020b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127192.900568:0:6685:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff8df7c2051200/0xeeacf7c02430020b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127192.900580:0:6685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a3a1a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:6685:1876035752696192:0@lo:101: 00000100:00100000:1.0:1789127192.900606:0:6685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127192.900618:0:6685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df786b37cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789127192.900885:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752696064 00000100:00100000:0.0:1789127192.900890:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752696064 00000100:00100000:0.0:1789127192.900926:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789127192.900933:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79a3a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+11:3303:x1876035752696064:12345-0@lo:103: 00010000:00010000:0.0:1789127192.900941:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789127192.900954:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df7c2173e00/0xeeacf7c0243001f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xeeacf7c0243001ef expref: 11 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127192.900969:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789127192.901002:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79a3a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+10:3303:x1876035752696064:12345-0@lo:103: Request processed in 69us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127192.901008:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789127192.901024:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752696192 00000100:00100000:0.0:1789127192.901027:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752696192 00000100:00100000:0.0:1789127192.901039:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789127192.901043:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7906ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+10:6685:x1876035752696192:12345-0@lo:101: 00010000:00010000:0.0:1789127192.901058:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127192.901067:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df780031800/0xeeacf7c024300212 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xeeacf7c02430020b expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127192.901081:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df780031800/0xeeacf7c024300212 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xeeacf7c02430020b expref: 11 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127192.901093:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df780031800/0xeeacf7c024300212 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c02430020b expref: 11 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127192.901100:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df780031800, rc 0) 00000100:00100000:0.0:1789127192.901122:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7906ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+11:6685:x1876035752696192:12345-0@lo:101: Request processed in 78us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127192.901127:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789127192.901213:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7af7cd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3303:1876035752696064:0@lo:103: 00000100:00100000:1.0:1789127192.901239:0:6685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a3a1a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:6685:1876035752696192:0@lo:101: 00010000:00010000:1.0:1789127192.901251:0:6685:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff8df7c2051200/0xeeacf7c02430020b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c024300212 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127192.901258:0:6685:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff8df7c2051200/0xeeacf7c02430020b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xeeacf7c024300212 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127192.901342:0:6685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a3a1a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:6685:1876035752696320:0@lo:501: 00000100:00100000:1.0:1789127192.901370:0:6685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127192.901391:0:6685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df786b37cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789127192.901443:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752696320 00000100:00100000:0.0:1789127192.901447:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752696320 00000100:00100000:0.0:1789127192.901463:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789127192.901468:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7906cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+11:6685:x1876035752696320:12345-0@lo:501: 00000100:00100000:0.0:1789127192.901683:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7906cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+11:6685:x1876035752696320:12345-0@lo:501: Request processed in 213us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127192.901700:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789127192.901847:0:6685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a3a1a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:6685:1876035752696320:0@lo:501: 00000100:00100000:1.0:1789127192.901875:0:6685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a3a1a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:6685:1876035752696448:0@lo:503: 00000100:00100000:1.0:1789127192.901914:0:6685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127192.901936:0:6685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df786b37cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789127192.902000:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752696448 00000100:00100000:0.0:1789127192.902010:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752696448 00000100:00100000:0.0:1789127192.902030:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789127192.902035:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7906c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+11:6685:x1876035752696448:12345-0@lo:503: 00000100:00100000:0.0:1789127192.902173:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7906c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+11:6685:x1876035752696448:12345-0@lo:503: Request processed in 136us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127192.902179:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789127192.902253:0:6685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a3a1a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:6685:1876035752696448:0@lo:503: 00000040:00080000:1.0:1789127192.902531:0:6685:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789127192.902585:0:6685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a3a1a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:6685:1876035752696576:0@lo:502: 00000100:00100000:1.0:1789127192.902619:0:6685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127192.902642:0:6685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df786b37cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789127192.902761:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752696576 00000100:00100000:0.0:1789127192.902765:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752696576 00000100:00100000:0.0:1789127192.902785:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789127192.902811:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7906cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+11:6685:x1876035752696576:12345-0@lo:502: 00000100:00100000:0.0:1789127192.902960:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7906cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+11:6685:x1876035752696576:12345-0@lo:502: Request processed in 149us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127192.902967:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789127192.903048:0:6685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a3a1a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:6685:1876035752696576:0@lo:502: 00000040:00080000:1.0:1789127192.903285:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1789127192.903337:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1789127192.903380:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1789127192.903431:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1789127192.903463:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1789127192.903489:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1789127192.903512:0:6685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a3a1a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:6685:1876035752696704:0@lo:502: 00000100:00100000:1.0:1789127192.903548:0:6685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127192.903581:0:6685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df786b37cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789127192.903625:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752696704 00000100:00100000:0.0:1789127192.903629:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752696704 00000100:00100000:0.0:1789127192.903649:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789127192.903737:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7906c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+11:6685:x1876035752696704:12345-0@lo:502: 00000100:00100000:0.0:1789127192.903899:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7906c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+11:6685:x1876035752696704:12345-0@lo:502: Request processed in 244us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127192.903906:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789127192.904082:0:6685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a3a1a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:6685:1876035752696704:0@lo:502: 00000040:00080000:1.0:1789127192.904166:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1789127192.904175:0:6685:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:3.0:1789127192.906110:0:6703:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789127192.906122:0:6703:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1789127192.906130:0:6703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127192.906132:0:6703:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1789127192.906139:0:6703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789127192.906154:0:6703:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8df7881dced8) 00000020:00000080:3.0:1789127192.906177:0:6703:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789127192.906183:0:6703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789127192.906241:0:6703:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8df788896800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1789127192.906249:0:6703:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789127192.906254:0:6703:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xeeacf7c024300220 00010000:00010000:3.0:1789127192.911577:0:6703:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:3.0:1789127192.912925:0:6703:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1789127192.919130:0:6703:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1789127192.919401:0:6703:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1789127192.930516:0:6703:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1789127192.931415:0:6703:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1789127192.935318:0:6703:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1789127192.935332:0:6703:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789127192.935338:0:6703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127192.935340:0:6703:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1789127192.935345:0:6703:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789127192.935349:0:6703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127192.935351:0:6703:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789127192.935361:0:6703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789127192.935363:0:6703:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789127192.935425:0:6703:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789127192.935430:0:6703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127192.935432:0:6703:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789127192.935435:0:6703:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1789127192.935861:0:6685:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:2.0:1789127192.935899:0:6685:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1789127192.935918:0:6685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df7c2051200/0xeeacf7c02430020b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c024300212 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127192.935929:0:6685:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff8df7c2051200/0xeeacf7c02430020b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c024300212 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127192.935938:0:6685:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df788896800 from 1 10000000:01000000:2.0:1789127192.935940:0:6685:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789127192.935980:0:6685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df7c2173e00/0xeeacf7c024300227 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127192.935989:0:6685:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff8df7c2173e00/0xeeacf7c024300227 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127192.935999:0:6685:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff8df7c2173e00/0xeeacf7c024300227 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127192.936019:0:6685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a387480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:6685:1876035752696832:0@lo:101: 00000100:00100000:2.0:1789127192.936091:0:6685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127192.936144:0:6685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df78802a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789127192.936214:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752696832 00000100:00100000:3.0:1789127192.936221:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752696832 00000100:00100000:3.0:1789127192.936265:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789127192.936279:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7906cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+11:6685:x1876035752696832:12345-0@lo:101: 00010000:00010000:3.0:1789127192.936291:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127192.936307:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df798df1c00/0xeeacf7c02430022e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xeeacf7c024300227 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127192.936332:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df798df1c00/0xeeacf7c02430022e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xeeacf7c024300227 expref: 12 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127192.936342:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df798df1c00/0xeeacf7c02430022e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c024300227 expref: 12 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127192.936350:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df798df1c00, rc 0) 00000100:00100000:3.0:1789127192.936401:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7906cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+12:6685:x1876035752696832:12345-0@lo:101: Request processed in 128us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127192.936414:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789127192.936763:0:6685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a387480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:6685:1876035752696832:0@lo:101: 00010000:00010000:2.0:1789127192.936784:0:6685:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff8df7c2173e00/0xeeacf7c024300227 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c02430022e expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127192.936817:0:6685:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff8df7c2173e00/0xeeacf7c024300227 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xeeacf7c02430022e expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127192.936905:0:6685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a387480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:6685:1876035752696960:0@lo:501: 00000100:00100000:2.0:1789127192.936942:0:6685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127192.936965:0:6685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df78802a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789127192.937020:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752696960 00000100:00100000:3.0:1789127192.937024:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752696960 00000100:00100000:3.0:1789127192.937055:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789127192.937061:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7880ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+12:6685:x1876035752696960:12345-0@lo:501: 00000100:00100000:3.0:1789127192.937280:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7880ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+12:6685:x1876035752696960:12345-0@lo:501: Request processed in 218us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127192.937287:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789127192.938853:0:6685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a387480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:6685:1876035752696960:0@lo:501: 00000100:00100000:2.0:1789127192.938912:0:6685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a387480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:6685:1876035752697088:0@lo:503: 00000100:00100000:2.0:1789127192.938976:0:6685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127192.939012:0:6685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df78802a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789127192.939038:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752697088 00000100:00100000:2.0:1789127192.939044:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752697088 00000100:00100000:2.0:1789127192.939093:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789127192.939102:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7880ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+12:6685:x1876035752697088:12345-0@lo:503: 00000100:00100000:2.0:1789127192.939351:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7880ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+12:6685:x1876035752697088:12345-0@lo:503: Request processed in 249us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127192.939358:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789127192.939410:0:6685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a387480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:6685:1876035752697088:0@lo:503: 00000040:00080000:2.0:1789127192.939759:0:6685:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789127192.939847:0:6685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a387480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:6685:1876035752697216:0@lo:502: 00000100:00100000:2.0:1789127192.939885:0:6685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127192.939902:0:6685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df791fe1e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789127192.939918:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752697216 00000100:00100000:2.0:1789127192.939922:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752697216 00000100:00100000:2.0:1789127192.939943:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789127192.939949:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7880ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+12:6685:x1876035752697216:12345-0@lo:502: 00000100:00100000:2.0:1789127192.940123:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7880ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+12:6685:x1876035752697216:12345-0@lo:502: Request processed in 172us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127192.940130:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789127192.940173:0:6685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a387480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:6685:1876035752697216:0@lo:502: 00000040:00080000:2.0:1789127192.940413:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1789127192.940457:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1789127192.940481:0:6685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a387480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:6685:1876035752697344:0@lo:502: 00000100:00100000:2.0:1789127192.940518:0:6685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127192.940533:0:6685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df78802a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789127192.940547:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752697344 00000100:00100000:2.0:1789127192.940550:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752697344 00000100:00100000:2.0:1789127192.940573:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789127192.940579:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7880ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+12:6685:x1876035752697344:12345-0@lo:502: 00000100:00100000:2.0:1789127192.943420:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7880ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+12:6685:x1876035752697344:12345-0@lo:502: Request processed in 2832us (2893us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127192.943433:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789127192.943518:0:6685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a387480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:6685:1876035752697344:0@lo:502: 00000040:00080000:2.0:1789127192.944107:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1789127192.944125:0:6685:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1789127192.951907:0:6707:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789127192.951920:0:6707:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127192.951923:0:6707:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789127192.951930:0:6707:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8df788896800 00000020:00000080:3.0:1789127192.951933:0:6707:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789127192.951954:0:6707:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789127192.951957:0:6707:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127192.951958:0:6707:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1789127192.951961:0:6707:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1789127192.952027:0:6685:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1789127192.952054:0:6685:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789127192.952077:0:6685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df7c2173e00/0xeeacf7c024300227 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c02430022e expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127192.952089:0:6685:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff8df7c2173e00/0xeeacf7c024300227 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c02430022e expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127192.952126:0:6685:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789127192.952129:0:6685:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8df788896800 10000000:01000000:3.0:1789127192.952132:0:6685:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8df788896800 10000000:01000000:3.0:1789127192.952136:0:6685:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789127192.952151:0:6685:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8df788896800 from 1 10000000:01000000:3.0:1789127192.952153:0:6685:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789127192.952187:0:6685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df798df1000/0xeeacf7c024300235 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127192.952195:0:6685:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff8df798df1000/0xeeacf7c024300235 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127192.952206:0:6685:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff8df798df1000/0xeeacf7c024300235 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127192.952228:0:6685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a2c5e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:6685:1876035752697472:0@lo:101: 00000100:00100000:3.0:1789127192.952291:0:6685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127192.952334:0:6685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df787750e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789127192.952356:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752697472 00000100:00100000:3.0:1789127192.952362:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752697472 00000100:00100000:3.0:1789127192.952402:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789127192.952411:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7880aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+12:6685:x1876035752697472:12345-0@lo:101: 00010000:00010000:3.0:1789127192.952423:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127192.952435:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df798df0a00/0xeeacf7c02430023c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xeeacf7c024300235 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127192.952456:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df798df0a00/0xeeacf7c02430023c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xeeacf7c024300235 expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127192.952466:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df798df0a00/0xeeacf7c02430023c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c024300235 expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127192.952476:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df798df0a00, rc 0) 00000100:00100000:3.0:1789127192.952512:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7880aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+13:6685:x1876035752697472:12345-0@lo:101: Request processed in 103us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127192.952525:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789127192.952572:0:6685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a2c5e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:6685:1876035752697472:0@lo:101: 00010000:00010000:3.0:1789127192.952586:0:6685:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff8df798df1000/0xeeacf7c024300235 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c02430023c expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127192.952596:0:6685:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff8df798df1000/0xeeacf7c024300235 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xeeacf7c02430023c expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127192.953287:0:6685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a2c5e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:6685:1876035752697600:0@lo:501: 00000100:00100000:3.0:1789127192.953318:0:6685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127192.953681:0:6685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df787750e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789127192.954037:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752697600 00000100:00100000:2.0:1789127192.954043:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752697600 00000100:00100000:0.0:1789127192.954419:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789127192.954429:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7880ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+13:6685:x1876035752697600:12345-0@lo:501: 00000100:00100000:0.0:1789127192.954823:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7880ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+13:6685:x1876035752697600:12345-0@lo:501: Request processed in 395us (1503us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127192.954831:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789127192.954978:0:6685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a2c5e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:6685:1876035752697600:0@lo:501: 00000100:00100000:1.0:1789127192.955016:0:6685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a3a1a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:6685:1876035752697728:0@lo:503: 00000100:00100000:1.0:1789127192.955058:0:6685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127192.955088:0:6685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df786b37180 going to sleep for 11 seconds 00000100:00100000:3.0:1789127192.955131:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752697728 00000100:00100000:3.0:1789127192.955136:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752697728 00000100:00100000:3.0:1789127192.955169:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789127192.955177:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7880adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+13:6685:x1876035752697728:12345-0@lo:503: 00000100:00100000:3.0:1789127192.955392:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7880adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+13:6685:x1876035752697728:12345-0@lo:503: Request processed in 216us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127192.955399:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789127192.955471:0:6685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a3a1a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:6685:1876035752697728:0@lo:503: 00000040:00080000:3.0:1789127192.956085:0:6685:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789127192.956161:0:6685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a2c43c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:6685:1876035752697856:0@lo:502: 00000100:00100000:3.0:1789127192.956200:0:6685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127192.956231:0:6685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df787750300 going to sleep for 11 seconds 00000100:00100000:1.0:1789127192.956276:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752697856 00000100:00100000:1.0:1789127192.956281:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752697856 00000100:00100000:1.0:1789127192.956316:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789127192.956324:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7880ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+13:6685:x1876035752697856:12345-0@lo:502: 00000100:00100000:1.0:1789127192.956501:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7880ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+13:6685:x1876035752697856:12345-0@lo:502: Request processed in 177us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127192.956513:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789127192.956587:0:6685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a2c43c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:6685:1876035752697856:0@lo:502: 00000040:00080000:2.0:1789127192.956908:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1789127192.956959:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1789127192.956995:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1789127192.957041:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1789127192.957077:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1789127192.957136:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1789127192.957177:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1789127192.957212:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1789127192.957274:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1789127192.957312:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1789127192.957346:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1789127192.957391:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1789127192.957428:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1789127192.957463:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1789127192.957527:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1789127192.957565:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1789127192.957600:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1789127192.957648:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1789127192.957987:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1789127192.958036:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1789127192.958098:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1789127192.958138:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1789127192.958170:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1789127192.958217:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1789127192.958255:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1789127192.958374:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1789127192.958446:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1789127192.958839:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:2.0:1789127192.958888:0:6685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a387480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:6685:1876035752697984:0@lo:502: 00000100:00100000:2.0:1789127192.958961:0:6685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127192.959001:0:6685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df78802a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789127192.959076:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752697984 00000100:00100000:1.0:1789127192.959083:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752697984 00000100:00100000:1.0:1789127192.959130:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789127192.959138:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7880acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+13:6685:x1876035752697984:12345-0@lo:502: 00000100:00100000:1.0:1789127192.959331:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7880acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+13:6685:x1876035752697984:12345-0@lo:502: Request processed in 194us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127192.959338:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789127192.959429:0:6685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a387480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:6685:1876035752697984:0@lo:502: 00000040:00080000:2.0:1789127192.959497:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1789127192.959506:0:6685:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1789127192.960355:0:6708:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1789127192.960371:0:6708:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8df7af70ced8) 00000020:00000080:0.0:1789127192.960393:0:6708:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:0.0:1789127192.960468:0:6708:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8df788896800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789127192.960472:0:6708:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8df788896800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789127192.960474:0:6708:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8df788896800 3 00010000:00080000:0.0:1789127192.960509:0:6708:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8df681af9800@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.140@tcp at head 00010000:00010000:0.0:1789127192.962198:0:6708:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:0.0:1789127192.962393:0:6708:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1789127192.967775:0:6708:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789127192.967825:0:6708:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xeeacf7c02430024a 00000100:00080000:0.0:1789127192.967843:0:6708:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789127192.967849:0:6708:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8df681af9800 using connection 192.168.206.140@tcp/0@lo 00000100:00100000:0.0:1789127192.967884:0:6708:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df7af7cc780 x1876035752698112/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789127192.967902:0:6708:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789127192.969490:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789127192.969510:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a2c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876035752698240:0@lo:400: 00000100:00100000:3.0:1789127192.969570:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127192.969630:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752698240 00000100:00100000:3.0:1789127192.969645:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752698240 00000100:00100000:3.0:1789127192.969766:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789127192.969775:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79a2c4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876035752698240:12345-0@lo:400: 00000100:00100000:3.0:1789127192.969845:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79a2c4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876035752698240:12345-0@lo:400: Request processed in 70us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127192.969852:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789127192.969889:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8df79a2c4000 x1876035752698240/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127208 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127192.969902:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a2c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876035752698240:0@lo:400: 00000100:00100000:1.0:1789127192.970016:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7af7cc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3299:1876035752698112:0@lo:38: 00000100:00100000:1.0:1789127192.970047:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1789127192.970847:0:6708:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:2.0:1789127192.971008:0:6685:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1789127192.971034:0:6685:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789127192.971059:0:6685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df798df1000/0xeeacf7c024300235 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c02430023c expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127192.971084:0:6685:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff8df798df1000/0xeeacf7c024300235 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c02430023c expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789127192.971128:0:6685:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789127192.971130:0:6685:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789127192.971132:0:6685:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789127192.971133:0:6685:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789127192.971134:0:6685:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789127192.971136:0:6685:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789127192.971137:0:6685:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789127192.971139:0:6685:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789127192.971140:0:6685:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789127192.971142:0:6685:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789127192.971143:0:6685:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789127192.971147:0:6685:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1789127192.971149:0:6685:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789127192.971150:0:6685:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789127192.971151:0:6685:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789127192.971152:0:6685:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789127192.971153:0:6685:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789127192.971154:0:6685:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789127192.971155:0:6685:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789127192.971156:0:6685:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789127192.971157:0:6685:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789127192.971157:0:6685:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789127192.971158:0:6685:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789127192.971177:0:6685:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789127192.971191:0:6685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a387480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:6685:1876035752698368:0@lo:253: 00000100:00100000:2.0:1789127192.971236:0:6685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127192.971263:0:6685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7a00efa80 going to sleep for 11 seconds 00000100:00100000:3.0:1789127192.971351:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752698112 00000100:00100000:3.0:1789127192.971357:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752698112 00000100:00100000:3.0:1789127192.971391:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789127192.971397:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79a3a1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3299:x1876035752698112:12345-0@lo:38: 00010000:00080000:3.0:1789127192.971418:0:5831:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 139 last 0 00000020:00000080:3.0:1789127192.971448:0:5831:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xeeacf7c024300251 00000004:00100000:3.0:1789127192.971464:0:5831:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789127192.971496:0:5831:0:(import.c:65:import_set_state_nolock()) ffff8df6811a1000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789127192.971548:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79a3a1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876035752698112:12345-0@lo:38: Request processed in 149us (1499us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127192.971555:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789127192.971596:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8df7af7cc780 x1876035752698112/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789127202 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127192.971607:0:3299:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789127192.971615:0:3299:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1789127192.971623:0:3299:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789127192.971628:0:3299:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789127192.971638:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8df681af9800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789127192.971644:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7af7cc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3299:1876035752698112:0@lo:38: 00000100:00100000:3.0:1789127192.971753:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752698368 00000100:00100000:3.0:1789127192.971758:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752698368 00000100:00100000:3.0:1789127192.971811:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789127192.971820:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7880afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+13:6685:x1876035752698368:12345-0@lo:253: 20000000:01000000:3.0:1789127192.971851:0:5824:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789127192.971864:0:5824:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789127192.999132:0:5824:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789127192.999151:0:5824:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1789127192.999203:0:5846:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789127192.999208:0:5846:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789127192.999228:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8df7c2172600/0xeeacf7c024300258 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127192.999258:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df7c2051000/0xeeacf7c0243001b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c0243001b0 expref: 13 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127192.999266:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8df7c2172600/0xeeacf7c024300258 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127192.999304:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df7c2051000/0xeeacf7c0243001b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xeeacf7c0243001b0 expref: 13 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127192.999317:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df7c2051000/0xeeacf7c0243001b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xeeacf7c0243001b0 expref: 13 pid: 5824 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127192.999331:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a3870c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5846:1876035752698496:0@lo:104: 00000100:00100000:2.0:1789127192.999394:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127192.999456:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df790c8a900 going to sleep for 11 seconds 00000100:00100000:3.0:1789127192.999511:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752698496 00000100:00100000:3.0:1789127192.999521:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752698496 00000100:00100000:3.0:1789127192.999571:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789127192.999580:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79a384000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+3:5846:x1876035752698496:12345-0@lo:104: 00010000:00010000:3.0:1789127192.999594:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.140@tcp lock: ffff8df7c2051c00/0xeeacf7c0243001b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xeeacf7c0243001b7 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127192.999648:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789127192.999666:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79a384000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+3:5846:x1876035752698496:12345-0@lo:104: Request processed in 76us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127192.999674:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1789127192.999706:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789127192.999711:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.140@tcp lock: ffff8df7c2051c00/0xeeacf7c0243001b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xeeacf7c0243001b7 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127192.999719:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7c2051c00 already unused, calling callback (ffffffffc1da1c20) 10000000:00010000:3.0:1789127192.999722:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.140@tcp lock: ffff8df7c2051c00/0xeeacf7c0243001b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xeeacf7c0243001b7 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127192.999729:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: ffff8df7c2051c00/0xeeacf7c0243001b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xeeacf7c0243001b7 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789127192.999743:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: ffff8df7c2051c00/0xeeacf7c0243001b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xeeacf7c0243001b7 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127192.999749:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789127192.999778:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.140@tcp lock: ffff8df7c2051c00/0xeeacf7c0243001b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c0243001b7 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127192.999784:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789127192.999821:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.140@tcp lock: ffff8df7c2051c00/0xeeacf7c0243001b0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c0243001b7 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127192.999829:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: ffff8df7c2051c00/0xeeacf7c0243001b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c0243001b7 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127192.999845:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127192.999846:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127192.999848:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127192.999866:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a2c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3301:1876035752698624:0@lo:103: 00000100:00100000:3.0:1789127192.999898:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127192.999934:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752698624 00000100:00100000:3.0:1789127192.999939:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752698624 00010000:00010000:3.0:1789127192.999954:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df7c2051000/0xeeacf7c0243001b7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xeeacf7c0243001b0 expref: 14 pid: 5824 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127192.999975:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789127192.999982:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7889c9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+14:3301:x1876035752698624:12345-0@lo:103: 00010000:00010000:3.0:1789127192.999992:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127192.999996:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df7c2051000/0xeeacf7c0243001b7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xeeacf7c0243001b0 expref: 14 pid: 5824 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127193.000014:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df7c2051000/0xeeacf7c0243001b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xeeacf7c0243001b0 expref: 14 pid: 5824 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127193.000029:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8df7c2172600/0xeeacf7c024300258 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127193.000036:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df7c2172600/0xeeacf7c024300258 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789127193.000048:0:5815:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001247033s 00010000:00010000:3.0:1789127193.000051:0:5815:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df7c2172600/0xeeacf7c024300258 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127193.000058:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df7c2172600/0xeeacf7c024300258 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127193.000063:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8df7c2172600/0xeeacf7c024300258 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127193.000068:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8df7c2172600/0xeeacf7c024300258 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127193.000073:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7c2172600 already unused, calling callback (ffffffffc17a4550) 00010000:00010000:3.0:1789127193.000076:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8df7c2172600/0xeeacf7c024300258 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127193.000082:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8df7c2172600/0xeeacf7c024300258 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127193.000091:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8df7c2172600/0xeeacf7c024300258 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127193.000108:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127193.000137:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7889c9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+14:3301:x1876035752698624:12345-0@lo:103: Request processed in 155us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127193.000144:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789127193.000201:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a2c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3301:1876035752698624:0@lo:103: 00010000:00010000:0.0:1789127193.000338:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df7c2051000/0xeeacf7c0243001b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xeeacf7c0243001b0 expref: 13 pid: 5824 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127193.000358:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a3870c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5846:1876035752698496:0@lo:104: 00010000:00010000:0.0:1789127193.000372:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8df7c2172600/0xeeacf7c024300258 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127193.000379:0:5846:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8df7c2172600/0xeeacf7c024300258 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127193.000385:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8df7c2172600/0xeeacf7c024300258 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127193.000391:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df7c2172600/0xeeacf7c024300258 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127193.005574:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7880afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+12:6685:x1876035752698368:12345-0@lo:253: Request processed in 33741us (34323us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127193.005589:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789127193.005710:0:6685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a387480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:6685:1876035752698368:0@lo:253: 10000000:01000000:2.0:1789127193.005725:0:6685:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789127193.005729:0:6685:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789127193.005730:0:6685:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789127193.005732:0:6685:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789127193.005733:0:6685:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789127193.005734:0:6685:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789127193.005735:0:6685:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789127193.005736:0:6685:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789127193.005738:0:6685:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789127193.005739:0:6685:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789127193.005741:0:6685:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789127193.005742:0:6685:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789127193.005758:0:6685:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1789127193.014869:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:3.0:1789127193.015288:0:6685:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1789127193.015494:0:6685:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1789127193.016247:0:6685:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1789127193.016454:0:6685:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1789127193.016715:0:6685:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x8:0x0] (8/8/4) registered 00080000:10000000:3.0:1789127193.016933:0:6685:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1789127193.019966:0:6685:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1789127193.235870:0:6685:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1789127193.235877:0:6685:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1789127193.235910:0:6685:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789127193.235969:0:6685:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.140@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789127193.235989:0:6685:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1789127193.236015:0:6685:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1789127194.035331:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127195.061936:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789127195.705733:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789127195.705743:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8df788820800 from 21 10000000:01000000:1.0:1789127195.705748:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789127195.705820:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df7c2051000/0xeeacf7c02430025f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127195.705832:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff8df7c2051000/0xeeacf7c02430025f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127195.705844:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff8df7c2051000/0xeeacf7c02430025f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127195.705885:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a3a1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752698752:0@lo:101: 00000100:00100000:1.0:1789127195.705955:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127195.706011:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7984cc480 going to sleep for 11 seconds 00000100:00100000:0.0:1789127195.706103:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752698752 00000100:00100000:0.0:1789127195.706110:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752698752 00000100:00100000:0.0:1789127195.706169:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789127195.706178:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7880ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+12:5827:x1876035752698752:12345-0@lo:101: 00010000:00010000:0.0:1789127195.706190:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127195.706204:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df780030600/0xeeacf7c024300266 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xeeacf7c02430025f expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127195.706226:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df780030600/0xeeacf7c024300266 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xeeacf7c02430025f expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127195.706237:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df780030600/0xeeacf7c024300266 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c02430025f expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127195.706256:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df780030600, rc 0) 00000100:00100000:0.0:1789127195.706296:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7880ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+13:5827:x1876035752698752:12345-0@lo:101: Request processed in 119us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127195.706302:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789127195.706346:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a3a1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752698752:0@lo:101: 00010000:00010000:0.0:1789127195.706360:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff8df7c2051000/0xeeacf7c02430025f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c024300266 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127195.706369:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff8df7c2051000/0xeeacf7c02430025f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xeeacf7c024300266 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127195.706440:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7af7cf840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752698880:0@lo:501: 00000100:00100000:0.0:1789127195.706464:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127195.706485:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df784d46780 going to sleep for 11 seconds 00000100:00100000:0.0:1789127195.706501:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752698880 00000100:00100000:0.0:1789127195.706505:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752698880 00000100:00100000:0.0:1789127195.706527:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789127195.706533:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7880af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+13:5827:x1876035752698880:12345-0@lo:501: 00000100:00100000:0.0:1789127195.706943:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7880af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+13:5827:x1876035752698880:12345-0@lo:501: Request processed in 408us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127195.706950:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789127195.706980:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7af7cf840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752698880:0@lo:501: 00000100:00100000:0.0:1789127195.707006:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7af7cf840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752699008:0@lo:503: 00000100:00100000:0.0:1789127195.707040:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127195.707058:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df784d46780 going to sleep for 11 seconds 00000100:00100000:0.0:1789127195.707074:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752699008 00000100:00100000:0.0:1789127195.707078:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752699008 00000100:00100000:0.0:1789127195.707098:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789127195.707105:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7880ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+13:5827:x1876035752699008:12345-0@lo:503: 00000100:00100000:0.0:1789127195.707363:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7880ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+13:5827:x1876035752699008:12345-0@lo:503: Request processed in 258us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127195.707369:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789127195.707405:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7af7cf840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752699008:0@lo:503: 00000100:00100000:0.0:1789127195.707583:0:6835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7af7cf840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:6835:1876035752699136:0@lo:502: 00000100:00100000:0.0:1789127195.707615:0:6835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127195.707632:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752699136 00000100:00100000:0.0:1789127195.707636:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752699136 00000100:00100000:0.0:1789127195.707656:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789127195.707662:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7880af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+13:6835:x1876035752699136:12345-0@lo:502: 00000100:00100000:0.0:1789127195.707900:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7880af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+13:6835:x1876035752699136:12345-0@lo:502: Request processed in 237us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127195.707907:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789127195.707942:0:6835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df784d46900 going to sleep for 11 seconds 00000100:00100000:0.0:1789127195.707954:0:6835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7af7cf840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:6835:1876035752699136:0@lo:502: 00000100:00100000:0.0:1789127195.707992:0:6835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7af7cf840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:6835:1876035752699264:0@lo:502: 00000100:00100000:0.0:1789127195.708021:0:6835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127195.708039:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752699264 00000100:00100000:0.0:1789127195.708042:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752699264 00000100:00100000:0.0:1789127195.708060:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789127195.708065:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7880ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+13:6835:x1876035752699264:12345-0@lo:502: 00000100:00100000:0.0:1789127195.708171:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7880ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+13:6835:x1876035752699264:12345-0@lo:502: Request processed in 105us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127195.708183:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789127195.708217:0:6835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df784d46900 going to sleep for 11 seconds 00000100:00100000:0.0:1789127195.708229:0:6835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7af7cf840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:6835:1876035752699264:0@lo:502: 00000040:00080000:0.0:1789127195.708248:0:6835:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1789127195.708294:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1789127195.708312:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789127195.708319:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df7c2051000/0xeeacf7c02430025f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c024300266 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127195.708330:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff8df7c2051000/0xeeacf7c02430025f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c024300266 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127195.708339:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789127195.708342:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8df788820800 from 4 10000000:01000000:0.0:1789127195.708344:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789127195.708368:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df780031000/0xeeacf7c02430026d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127195.708376:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff8df780031000/0xeeacf7c02430026d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127195.708384:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff8df780031000/0xeeacf7c02430026d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127195.708396:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7af7cf840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752699392:0@lo:101: 00000100:00100000:0.0:1789127195.708422:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127195.708435:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df784d46900 going to sleep for 11 seconds 00000100:00100000:0.0:1789127195.708446:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752699392 00000100:00100000:0.0:1789127195.708448:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752699392 00000100:00100000:0.0:1789127195.708485:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789127195.708492:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7880af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+13:5827:x1876035752699392:12345-0@lo:101: 00010000:00010000:0.0:1789127195.708500:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127195.708511:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df780030e00/0xeeacf7c024300274 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xeeacf7c02430026d expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127195.708530:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df780030e00/0xeeacf7c024300274 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xeeacf7c02430026d expref: 14 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127195.708540:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df780030e00/0xeeacf7c024300274 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c02430026d expref: 14 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127195.708548:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df780030e00, rc 0) 00000100:00100000:0.0:1789127195.708576:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7880af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+14:5827:x1876035752699392:12345-0@lo:101: Request processed in 85us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127195.708582:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789127195.708612:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7af7cf840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752699392:0@lo:101: 00010000:00010000:0.0:1789127195.708623:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff8df780031000/0xeeacf7c02430026d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c024300274 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127195.708631:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff8df780031000/0xeeacf7c02430026d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xeeacf7c024300274 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127195.708685:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7af7cf840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752699520:0@lo:256: 00000100:00100000:0.0:1789127195.708715:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127195.708727:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df784d46900 going to sleep for 11 seconds 00000100:00100000:0.0:1789127195.708737:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752699520 00000100:00100000:0.0:1789127195.708740:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752699520 00000100:00100000:0.0:1789127195.708759:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789127195.708772:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df786b43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+14:5827:x1876035752699520:12345-0@lo:256: 20000000:01000000:0.0:1789127195.708785:0:5824:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789127195.708846:0:5824:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789127195.708850:0:5824:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1789127195.711114:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df786b43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+14:5827:x1876035752699520:12345-0@lo:256: Request processed in 2334us (2388us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127195.711128:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789127195.712542:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7af7cf840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752699520:0@lo:256: 10000000:01000000:2.0:1789127195.712716:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789127195.712727:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df780031000/0xeeacf7c02430026d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c024300274 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127195.712747:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff8df780031000/0xeeacf7c02430026d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c024300274 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127195.712756:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789127195.712759:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1789127195.712761:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789127195.712826:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df7c2173200/0xeeacf7c02430027b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127195.712833:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff8df7c2173200/0xeeacf7c02430027b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127195.712842:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff8df7c2173200/0xeeacf7c02430027b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127195.712862:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a385a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752699648:0@lo:101: 00000100:00100000:2.0:1789127195.712923:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127195.712965:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7988fb300 going to sleep for 11 seconds 00000100:00100000:1.0:1789127195.713027:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752699648 00000100:00100000:1.0:1789127195.713033:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752699648 00000100:00100000:1.0:1789127195.713073:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789127195.713081:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df786b40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+14:5827:x1876035752699648:12345-0@lo:101: 00010000:00010000:1.0:1789127195.713095:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127195.713107:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df7c2051c00/0xeeacf7c024300282 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xeeacf7c02430027b expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127195.713129:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df7c2051c00/0xeeacf7c024300282 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xeeacf7c02430027b expref: 15 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127195.713139:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df7c2051c00/0xeeacf7c024300282 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c02430027b expref: 15 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127195.713149:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7c2051c00, rc 0) 00000100:00100000:1.0:1789127195.713191:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df786b40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+15:5827:x1876035752699648:12345-0@lo:101: Request processed in 110us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127195.713199:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789127195.713487:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a385a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752699648:0@lo:101: 00010000:00010000:2.0:1789127195.713501:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff8df7c2173200/0xeeacf7c02430027b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c024300282 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127195.713510:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff8df7c2173200/0xeeacf7c02430027b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xeeacf7c024300282 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127195.713558:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a385a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752699776:0@lo:501: 00000100:00100000:2.0:1789127195.713584:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127195.713618:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7988fb300 going to sleep for 11 seconds 00000100:00100000:0.0:1789127195.713700:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752699776 00000100:00100000:0.0:1789127195.713705:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752699776 00000100:00100000:0.0:1789127195.713739:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789127195.713746:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df786b43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+15:5827:x1876035752699776:12345-0@lo:501: 00000100:00100000:0.0:1789127195.714007:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df786b43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+15:5827:x1876035752699776:12345-0@lo:501: Request processed in 261us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127195.714014:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789127195.714180:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a385a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752699776:0@lo:501: 00000100:00100000:2.0:1789127195.714206:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a385a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752699904:0@lo:503: 00000100:00100000:2.0:1789127195.714241:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127195.714268:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7988fb300 going to sleep for 11 seconds 00000100:00100000:0.0:1789127195.714305:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752699904 00000100:00100000:0.0:1789127195.714310:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752699904 00000100:00100000:0.0:1789127195.714340:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789127195.714347:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7902d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+15:5827:x1876035752699904:12345-0@lo:503: 00000100:00100000:0.0:1789127195.715264:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7902d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+15:5827:x1876035752699904:12345-0@lo:503: Request processed in 913us (1017us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127195.715272:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789127195.715361:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a385a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752699904:0@lo:503: 00000100:00100000:2.0:1789127195.719659:0:6836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a385a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:6836:1876035752700032:0@lo:502: 00000100:00100000:2.0:1789127195.719768:0:6836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127195.719837:0:6836:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7988fbb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789127195.719927:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752700032 00000100:00100000:1.0:1789127195.719935:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752700032 00000100:00100000:1.0:1789127195.719983:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789127195.719994:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7902da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+15:6836:x1876035752700032:12345-0@lo:502: 00000100:00100000:1.0:1789127195.720312:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7902da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+15:6836:x1876035752700032:12345-0@lo:502: Request processed in 319us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127195.720322:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789127195.722498:0:6836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a385a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:6836:1876035752700032:0@lo:502: 00000020:01000000:2.0:1789127195.722543:0:6836:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789127195.722551:0:6836:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1789127195.722559:0:6836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127195.722562:0:6836:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1789127195.722568:0:6836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789127195.722572:0:6836:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.140@tcp to nid 0x20000c0a8ce8c (192.168.206.140@tcp) 00000020:01000000:2.0:1789127195.722597:0:6836:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1789127195.722601:0:6836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789127195.722619:0:6836:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8df790234ed8) 00000020:00000080:2.0:1789127195.722640:0:6836:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:2.0:1789127195.722646:0:6836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789127195.722753:0:6836:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1789127195.722760:0:6836:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:2.0:1789127195.722766:0:6836:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xeeacf7c024300290 00010000:00080000:2.0:1789127195.722815:0:6836:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8df7af45d000@lustre-OST0000-osc-MDT0000: add connection 192.168.206.140@tcp at head 00010000:00010000:2.0:1789127195.723073:0:6836:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1789127195.845193:0:6836:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1789127195.845220:0:6836:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1789127195.845981:0:6836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789127195.846214:0:6836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789127195.846264:0:6836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1789127195.846319:0:6836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1789127195.847502:0:6839:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789127195.847508:0:6839:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1789127195.848834:0:6836:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789127195.848847:0:6836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789127195.848882:0:6836:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1789127195.848903:0:6836:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xeeacf7c024300297 00000100:00080000:0.0:1789127195.848914:0:6836:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789127195.848920:0:6836:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8df7af45d000 using connection 192.168.206.140@tcp/0@lo 00000100:00100000:0.0:1789127195.848956:0:6836:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df7af7ccb40 x1876035752700160/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789127195.848983:0:6836:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1789127195.849043:0:6836:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789127195.849046:0:6836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127195.849048:0:6836:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1789127195.849051:0:6836:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789127195.849055:0:6836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127195.849057:0:6836:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789127195.849059:0:6836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789127195.849062:0:6836:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789127195.849071:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a385a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3302:1876035752700288:0@lo:400: 00000100:00100000:0.0:1789127195.849082:0:6836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7af7ced00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:6836:1876035752700672:0@lo:502: 00000100:00100000:2.0:1789127195.849147:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127195.849193:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789127195.849199:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a385e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876035752700416:0@lo:400: 00000100:00100000:2.0:1789127195.849273:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127195.849306:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a387480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1876035752700544:0@lo:400: 00000100:00100000:2.0:1789127195.849333:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127195.849372:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752700288 00000100:00100000:2.0:1789127195.849378:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752700288 00000100:00100000:2.0:1789127195.849417:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789127195.849425:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df790dc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+15:3302:x1876035752700288:12345-0@lo:400: 00000100:00100000:2.0:1789127195.849470:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df790dc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+15:3302:x1876035752700288:12345-0@lo:400: Request processed in 45us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127195.849477:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789127195.849504:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752700416 00000100:00100000:2.0:1789127195.849507:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752700416 00000100:00100000:2.0:1789127195.849528:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752700544 00000100:00100000:2.0:1789127195.849530:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752700544 00000100:00100000:2.0:1789127195.849553:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789127195.849559:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79a384f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876035752700416:12345-0@lo:400: 00000100:00100000:2.0:1789127195.849589:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79a384f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876035752700416:12345-0@lo:400: Request processed in 31us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127195.849595:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789127195.849614:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789127195.849620:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79a3870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876035752700544:12345-0@lo:400: 00000100:00100000:2.0:1789127195.849663:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79a3870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876035752700544:12345-0@lo:400: Request processed in 43us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127195.849678:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1789127195.849714:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df79a385e00 x1876035752700416/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127211 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127195.849726:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a385e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876035752700416:0@lo:400: 00000100:00100000:2.0:1789127195.849736:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a385a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3302:1876035752700288:0@lo:400: 00000100:00100000:3.0:1789127195.849749:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7af7ccb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1876035752700160:0@lo:8: 00000100:00080000:2.0:1789127195.849758:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789127195.849774:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df79a387480 x1876035752700544/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127211 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127195.849782:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127195.849782:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a387480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1876035752700544:0@lo:400: 00000100:00100000:1.0:1789127195.849974:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752700160 00000100:00100000:1.0:1789127195.849979:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752700160 00000100:00100000:1.0:1789127195.850001:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789127195.850006:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79a2c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3299:x1876035752700160:12345-0@lo:8: 00010000:00080000:1.0:1789127195.850026:0:6686:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 142 last 0 00000020:00000080:1.0:1789127195.850050:0:6686:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xeeacf7c02430029e 00002000:00100000:1.0:1789127195.850079:0:6686:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8df7b45fd800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113987 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1789127195.850084:0:6686:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:1.0:1789127195.850088:0:6686:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1789127195.850214:0:6686:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789127195.850351:0:6686:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789127195.850372:0:6686:0:(import.c:65:import_set_state_nolock()) ffff8df7b45f8800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789127195.850412:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79a2c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3299:x1876035752700160:12345-0@lo:8: Request processed in 404us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127195.850419:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789127195.850751:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df7af7ccb40 x1876035752700160/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789127205 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127195.850760:0:3299:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789127195.850768:0:3299:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1789127195.850776:0:3299:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789127195.850781:0:3299:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1789127195.850783:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8df7af45d000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789127195.850823:0:3299:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789127195.850829:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7af7ccb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1876035752700160:0@lo:8: 00000100:00100000:0.0:1789127195.851243:0:6836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127195.851282:0:6836:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df790c8aa80 going to sleep for 11 seconds 00000004:00080000:1.0:1789127195.852424:0:6839:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:3.0:1789127195.853270:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752700672 00000100:00100000:3.0:1789127195.853282:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752700672 00000100:00100000:3.0:1789127195.853334:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789127195.853345:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df790dc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+15:6836:x1876035752700672:12345-0@lo:502: 00000100:00100000:3.0:1789127195.853620:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df790dc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+15:6836:x1876035752700672:12345-0@lo:502: Request processed in 277us (2377us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127195.853628:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789127195.853715:0:6836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7af7ced00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:6836:1876035752700672:0@lo:502: 00000020:01000000:3.0:1789127195.853748:0:6836:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789127195.853756:0:6836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127195.853758:0:6836:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789127195.853763:0:6836:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:3.0:1789127195.853887:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:3.0:1789127195.853903:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789127195.853912:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df7c2173200/0xeeacf7c02430027b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c024300282 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127195.853922:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff8df7c2173200/0xeeacf7c02430027b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c024300282 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127195.853931:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1789127195.853933:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8df790d38000 from 1 10000000:01000000:3.0:1789127195.853936:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789127195.853967:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df798df0800/0xeeacf7c0243002a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127195.853975:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff8df798df0800/0xeeacf7c0243002a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127195.853992:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff8df798df0800/0xeeacf7c0243002a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127195.854013:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a2c61c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752700800:0@lo:101: 00000100:00100000:3.0:1789127195.854050:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127195.854071:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7877500c0 going to sleep for 11 seconds 00000004:00080000:1.0:1789127195.854427:0:6839:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 142010636819ns, next at 0ns, rc = 0 00000100:00100000:2.0:1789127195.857006:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752700800 00000100:00100000:2.0:1789127195.857020:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752700800 00000100:00100000:2.0:1789127195.857082:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789127195.857092:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df787bb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+15:5827:x1876035752700800:12345-0@lo:101: 00010000:00010000:2.0:1789127195.857909:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127195.857930:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df7c2172a00/0xeeacf7c0243002ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xeeacf7c0243002a5 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127195.857959:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df7c2172a00/0xeeacf7c0243002ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xeeacf7c0243002a5 expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127195.857971:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df7c2172a00/0xeeacf7c0243002ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c0243002a5 expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127195.857992:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7c2172a00, rc 0) 00000100:00100000:2.0:1789127195.858071:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df787bb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+16:5827:x1876035752700800:12345-0@lo:101: Request processed in 980us (4020us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127195.858078:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789127195.858163:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a2c61c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752700800:0@lo:101: 00010000:00010000:2.0:1789127195.858181:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff8df798df0800/0xeeacf7c0243002a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c0243002ac expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127195.858190:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff8df798df0800/0xeeacf7c0243002a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xeeacf7c0243002ac expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127195.858257:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a387480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752700928:0@lo:501: 00000100:00100000:2.0:1789127195.858289:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127195.858320:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7988fb240 going to sleep for 11 seconds 00000100:00100000:2.0:1789127195.858336:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752700928 00000100:00100000:2.0:1789127195.858340:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752700928 00000100:00100000:2.0:1789127195.858364:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789127195.858372:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df787bbb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+16:5827:x1876035752700928:12345-0@lo:501: 00000100:00100000:2.0:1789127195.858543:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df787bbb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+16:5827:x1876035752700928:12345-0@lo:501: Request processed in 172us (253us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789127195.858550:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789127195.860762:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a387480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752700928:0@lo:501: 10000000:01000000:2.0:1789127195.860819:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789127195.860830:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df798df0800/0xeeacf7c0243002a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c0243002ac expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127195.860852:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff8df798df0800/0xeeacf7c0243002a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c0243002ac expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789127195.927945:0:6840:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1789127195.927976:0:6840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7af7cfc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6840:1876035752701184:0@lo:7: 00000100:00100000:0.0:1789127195.928047:0:6840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127195.928102:0:6840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df791fe1900 going to sleep for 11 seconds 00000100:00100000:1.0:1789127195.928173:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789127195.928187:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7af7cf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1876035752701056:0@lo:13: 00000100:00100000:1.0:1789127195.928241:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127195.928290:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752701184 00000100:00100000:1.0:1789127195.928296:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752701184 00000100:00100000:1.0:1789127195.928348:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789127195.928357:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7af7ccf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6840:x1876035752701184:12345-0@lo:7: 00000004:00080000:3.0:1789127195.928828:0:5852:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:0.0:1789127195.931109:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752701056 00000100:00100000:0.0:1789127195.931123:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752701056 00000100:00100000:0.0:1789127195.931178:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789127195.931188:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79a3a03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3300:x1876035752701056:12345-0@lo:13: 00002000:00000024:0.0:1789127195.931221:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1789127195.931316:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79a3a03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3300:x1876035752701056:12345-0@lo:13: Request processed in 129us (3073us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127195.931323:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1789127195.932008:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789127195.938825:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df7af7cf0c0 x1876035752701056/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127211 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127195.938852:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7af7cf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1876035752701056:0@lo:13: 00002000:00080000:1.0:1789127195.943949:0:6689:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:1.0:1789127195.943958:0:6689:0:(ofd_dev.c:1222:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:1.0:1789127195.944052:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7af7ccf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6840:x1876035752701184:12345-0@lo:7: Request processed in 15693us (16000us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127195.944062:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789127195.945542:0:6840:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df7af7cfc00 x1876035752701184/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789127211 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127195.945561:0:6840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7af7cfc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6840:1876035752701184:0@lo:7: 00000004:00080000:3.0:1789127195.945587:0:6840:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:3.0:1789127195.945968:0:6840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a2c5a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6840:1876035752701312:0@lo:5: 00000100:00100000:3.0:1789127195.946025:0:6840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127195.946088:0:6840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7984b8840 going to sleep for 11 seconds 00000100:00100000:1.0:1789127195.946866:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752701312 00000100:00100000:1.0:1789127195.946875:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752701312 00000100:00100000:1.0:1789127195.946941:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789127195.946952:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79a2c5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6840:x1876035752701312:12345-0@lo:5: 00002000:00080000:1.0:1789127195.946980:0:6688:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1789127195.946985:0:6688:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1789127195.947329:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79a2c5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6840:x1876035752701312:12345-0@lo:5: Request processed in 378us (1302us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1789127195.947337:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789127195.948970:0:6840:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df79a2c5a40 x1876035752701312/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789127211 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127195.948989:0:6840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a2c5a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6840:1876035752701312:0@lo:5: 00000004:00080000:3.0:1789127195.949003:0:6840:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:3.0:1789127195.949041:0:6840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a2c52c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6840:1876035752701440:0@lo:700: 00000100:00100000:3.0:1789127195.949090:0:6840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127195.949127:0:6840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7984b8840 going to sleep for 11 seconds 00000100:00100000:0.0:1789127195.950029:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752701440 00000100:00100000:0.0:1789127195.950037:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752701440 00000100:00100000:0.0:1789127195.950141:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789127195.950159:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79a2c70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6840:x1876035752701440:12345-0@lo:700: 00000100:00100000:0.0:1789127195.950202:0:6695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7af7cf480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6695:1876035752701568:0@lo:700: 00000100:00100000:0.0:1789127195.950251:0:6695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127195.950280:0:6695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df791fe1e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789127195.952087:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752701568 00000100:00100000:3.0:1789127195.952098:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752701568 00000100:00100000:3.0:1789127195.952145:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789127195.952154:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7af7ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6695:x1876035752701568:12345-0@lo:700: 40000000:02000000:3.0:1789127196.021228:0:5837:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:3.0:1789127196.033041:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7af7ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6695:x1876035752701568:12345-0@lo:700: Request processed in 80877us (82778us total) trans 0 rc 0/0 00010000:00080000:1.0:1789127196.034335:0:6695:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df7af7cf480 x1876035752701568/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789127211 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127196.034351:0:6695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7af7cf480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6695:1876035752701568:0@lo:700: 40000000:02000000:1.0:1789127196.034364:0:6695:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:3.0:1789127196.034870:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1789127196.083333:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789127196.160296:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:3.0:1789127196.160314:0:6714:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1789127196.160443:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79a2c70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6840:x1876035752701440:12345-0@lo:700: Request processed in 210281us (211347us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127196.160461:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789127196.160544:0:6840:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df79a2c52c0 x1876035752701440/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789127211 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127196.160556:0:6840:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1789127196.160572:0:6840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a2c52c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6840:1876035752701440:0@lo:700: 00000004:02000040:3.0:1789127196.225936:0:6840:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:3.0:1789127196.231442:0:6840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a2c52c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6840:1876035752701696:0@lo:5: 00000100:00100000:3.0:1789127196.231518:0:6840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127196.231582:0:6840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7af673f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789127196.231709:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752701696 00000100:00100000:0.0:1789127196.231716:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752701696 00000100:00100000:0.0:1789127196.231776:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789127196.231827:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79a2c5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6840:x1876035752701696:12345-0@lo:5: 00002000:00080000:0.0:1789127196.244362:0:6689:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1789127196.244383:0:6689:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:0.0:1789127196.257974:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79a2c5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6840:x1876035752701696:12345-0@lo:5: Request processed in 26180us (26446us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1789127196.257989:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789127196.258918:0:6840:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df79a2c52c0 x1876035752701696/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789127212 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127196.259127:0:6840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a2c52c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6840:1876035752701696:0@lo:5: 00000004:00080000:3.0:1789127196.259145:0:6840:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:0.0:1789127197.107496:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127198.131517:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127199.156127:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789127199.899542:0:7057:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789127200.184254:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127201.203926:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127201.271786:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7af7cd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3302:1876035752701824:0@lo:400: 00000100:00100000:0.0:1789127201.271866:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127201.271914:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a2c43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752702336:0@lo:13: 00000100:00100000:0.0:1789127201.271981:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127201.272007:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789127201.272014:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7af7ce580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876035752701952:0@lo:400: 00000100:00100000:0.0:1789127201.272039:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127201.272069:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7af7cfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1876035752702208:0@lo:400: 00000100:00100000:0.0:1789127201.272091:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127201.272111:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789127201.272117:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7af7cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1876035752702080:0@lo:400: 00000100:00100000:0.0:1789127201.272148:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127201.272180:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752701824 00000100:00100000:0.0:1789127201.272188:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752701824 00000100:00100000:0.0:1789127201.272238:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789127201.272246:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df787bb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+16:3302:x1876035752701824:12345-0@lo:400: 00000100:00100000:0.0:1789127201.272294:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df787bb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+16:3302:x1876035752701824:12345-0@lo:400: Request processed in 48us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127201.272302:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789127201.272332:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752702336 00000100:00100000:0.0:1789127201.272336:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752702336 00000100:00100000:0.0:1789127201.272367:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789127201.272374:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7af7cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1876035752702336:12345-0@lo:13: 00002000:00000024:0.0:1789127201.272401:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789127201.272433:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7af7cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1876035752702336:12345-0@lo:13: Request processed in 60us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127201.272439:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789127201.272457:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752701952 00000100:00100000:0.0:1789127201.272461:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752701952 00000100:00100000:0.0:1789127201.272484:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752702080 00000100:00100000:0.0:1789127201.272487:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752702080 00000100:00100000:0.0:1789127201.272503:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789127201.272509:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7af7ced00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876035752701952:12345-0@lo:400: 00000100:00100000:0.0:1789127201.272539:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7af7ced00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876035752701952:12345-0@lo:400: Request processed in 31us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127201.272545:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789127201.272555:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789127201.272561:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7af7cf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876035752702080:12345-0@lo:400: 00000100:00100000:0.0:1789127201.272761:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7af7cf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876035752702080:12345-0@lo:400: Request processed in 199us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127201.272767:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789127201.272806:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752702208 00000100:00100000:0.0:1789127201.272810:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752702208 00000100:00100000:0.0:1789127201.272835:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789127201.272841:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7af7ccb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3301:x1876035752702208:12345-0@lo:400: 00000100:00100000:0.0:1789127201.272869:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7af7ccb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3301:x1876035752702208:12345-0@lo:400: Request processed in 29us (777us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127201.272875:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1789127201.272893:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789127201.272897:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789127201.272941:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df7af7cf480 x1876035752702080/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127217 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127201.272954:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7af7cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1876035752702080:0@lo:400: 00010000:00080000:0.0:1789127201.272965:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df7af7cfc00 x1876035752702208/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127217 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127201.272973:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7af7cfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1876035752702208:0@lo:400: 00010000:00080000:0.0:1789127201.273000:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df7af7ce580 x1876035752701952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127217 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127201.273008:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7af7ce580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876035752701952:0@lo:400: 00000100:00100000:0.0:1789127201.273016:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7af7cd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3302:1876035752701824:0@lo:400: 00010000:00080000:0.0:1789127201.273024:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df79a2c43c0 x1876035752702336/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127217 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127201.273037:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a2c43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752702336:0@lo:13: 00000001:00080000:3.0:1789127201.378732:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:2.0:1789127202.227197:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127203.259767:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127204.282707:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127205.300164:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127206.326175:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127206.389002:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7af7cfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3303:1876035752702464:0@lo:400: 00000100:00100000:0.0:1789127206.389065:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127206.389105:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7af7cd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1876035752702976:0@lo:13: 00000100:00100000:0.0:1789127206.389140:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127206.389163:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789127206.389168:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7af7cc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1876035752702848:0@lo:400: 00000100:00100000:0.0:1789127206.389186:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127206.389208:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7af7cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876035752702592:0@lo:400: 00000100:00100000:0.0:1789127206.389228:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127206.389243:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789127206.389248:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7af7cc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1876035752702720:0@lo:400: 00000100:00100000:0.0:1789127206.389282:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127206.389325:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752702464 00000100:00100000:0.0:1789127206.389331:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752702464 00000100:00100000:0.0:1789127206.389368:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789127206.389375:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df787bb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+16:3303:x1876035752702464:12345-0@lo:400: 00000100:00100000:0.0:1789127206.389415:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df787bb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+16:3303:x1876035752702464:12345-0@lo:400: Request processed in 40us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127206.389421:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789127206.389446:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752702976 00000100:00100000:0.0:1789127206.389449:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752702976 00000100:00100000:0.0:1789127206.389475:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789127206.389480:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7af7cda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876035752702976:12345-0@lo:13: 00002000:00000024:0.0:1789127206.389505:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789127206.389530:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7af7cda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876035752702976:12345-0@lo:13: Request processed in 50us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127206.389544:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789127206.389559:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752702848 00000100:00100000:0.0:1789127206.389562:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752702848 00000100:00100000:0.0:1789127206.389582:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789127206.389588:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7af7cd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1876035752702848:12345-0@lo:400: 00000100:00100000:0.0:1789127206.389627:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7af7cd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1876035752702848:12345-0@lo:400: Request processed in 38us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127206.389633:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789127206.389650:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752702592 00000100:00100000:0.0:1789127206.389653:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752702592 00000100:00100000:0.0:1789127206.389674:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752702720 00000100:00100000:0.0:1789127206.389677:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752702720 00000100:00100000:0.0:1789127206.389692:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789127206.389697:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7af7ce580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876035752702592:12345-0@lo:400: 00000100:00100000:0.0:1789127206.389730:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7af7ce580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876035752702592:12345-0@lo:400: Request processed in 32us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127206.389737:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789127206.389749:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789127206.389755:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeae61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876035752702720:12345-0@lo:400: 00000100:00100000:0.0:1789127206.389779:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeae61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876035752702720:12345-0@lo:400: Request processed in 24us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127206.389784:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1789127206.389821:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789127206.389825:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789127206.390068:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df7af7cc3c0 x1876035752702720/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127222 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127206.390082:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7af7cc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1876035752702720:0@lo:400: 00010000:00080000:0.0:1789127206.390098:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df7af7cf480 x1876035752702592/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127222 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127206.390106:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7af7cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876035752702592:0@lo:400: 00010000:00080000:0.0:1789127206.390167:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df7af7cc780 x1876035752702848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127222 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127206.390175:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1789127206.390184:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7af7cc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1876035752702848:0@lo:400: 00000100:00100000:0.0:1789127206.390408:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7af7cfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3303:1876035752702464:0@lo:400: 00010000:00080000:0.0:1789127206.390417:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df7af7cd680 x1876035752702976/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127222 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127206.390429:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7af7cd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1876035752702976:0@lo:13: 00010000:00010000:2.0:1789127207.348057:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127208.373961:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127209.394874:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127210.423694:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127211.442990:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127211.508017:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a3a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1876035752703104:0@lo:13: 00000100:00100000:1.0:1789127211.508083:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127211.508206:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a384780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3301:1876035752703232:0@lo:400: 00000100:00100000:1.0:1789127211.508248:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127211.509504:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752703232 00000100:00100000:2.0:1789127211.509514:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752703232 00000100:00100000:2.0:1789127211.509569:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789127211.509579:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df787bb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+16:3301:x1876035752703232:12345-0@lo:400: 00000100:00100000:2.0:1789127211.509668:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df787bb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+16:3301:x1876035752703232:12345-0@lo:400: Request processed in 90us (1417us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127211.509676:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789127211.509820:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a384780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3301:1876035752703232:0@lo:400: 00000100:00100000:0.0:1789127211.509880:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752703104 00000100:00100000:0.0:1789127211.509885:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752703104 00000100:00100000:0.0:1789127211.509920:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789127211.509927:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79a3a0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876035752703104:12345-0@lo:13: 00002000:00000024:0.0:1789127211.509954:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789127211.510001:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79a3a0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876035752703104:12345-0@lo:13: Request processed in 75us (1918us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127211.510008:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789127211.510031:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a385e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876035752703360:0@lo:400: 00000100:00100000:0.0:1789127211.510064:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127211.510088:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789127211.510094:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a385a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1876035752703488:0@lo:400: 00000100:00100000:0.0:1789127211.510114:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127211.510271:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752703360 00000100:00100000:0.0:1789127211.510276:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752703360 00000100:00100000:0.0:1789127211.510300:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752703488 00000100:00100000:0.0:1789127211.510303:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752703488 00000100:00100000:0.0:1789127211.510320:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789127211.510327:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeae5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876035752703360:12345-0@lo:400: 00000100:00100000:0.0:1789127211.510363:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeae5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876035752703360:12345-0@lo:400: Request processed in 37us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127211.510369:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1789127211.510373:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df79a3a2940 x1876035752703104/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127227 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127211.510380:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789127211.510387:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeae5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876035752703488:12345-0@lo:400: 00000100:00100000:0.0:1789127211.510414:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeae5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876035752703488:12345-0@lo:400: Request processed in 28us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127211.510420:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1789127211.510450:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df79a385a40 x1876035752703488/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127227 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127211.510461:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a385a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1876035752703488:0@lo:400: 00010000:00080000:0.0:1789127211.510470:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df79a385e00 x1876035752703360/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127227 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127211.510479:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a385e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876035752703360:0@lo:400: 00000100:00080000:3.0:1789127211.510542:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789127211.510547:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789127211.511002:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a3a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1876035752703104:0@lo:13: 00000020:01000004:0.0:1789127211.640329:0:7628:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789127211.640333:0:7628:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1789127211.640925:0:7628:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8df7b45fe800 00000020:01000004:0.0:1789127211.640941:0:7628:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1789127211.640954:0:7628:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1789127211.640967:0:7628:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8df7af708000) 00000020:00000080:0.0:1789127211.640982:0:7628:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1789127211.686409:0:7628:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1789127211.689234:0:7628:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1789127211.732418:0:7628:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1789127211.740241:0:7628:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789127211.740276:0:7628:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1789127211.740347:0:7628:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789127211.740379:0:7628:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1789127211.742707:0:7628:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1789127211.742723:0:7628:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789127211.742752:0:7628:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xeeacf7c0243002ba 00000020:01000004:2.0:1789127211.742769:0:7628:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1789127211.742814:0:7628:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.140@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789127211.742818:0:7628:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.140@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789127211.742824:0:7628:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1789127211.742853:0:7628:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1789127211.742858:0:7628:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.140@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1789127211.767446:0:7628:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.140@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789127211.767844:0:7628:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.140@tcp, index=0001, flags=0x20062 00000020:01000004:1.0:1789127211.767848:0:7628:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789127211.767849:0:7628:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789127211.767851:0:7628:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789127211.767852:0:7628:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789127211.767853:0:7628:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789127211.767854:0:7628:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789127211.767855:0:7628:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789127211.767857:0:7628:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789127211.767858:0:7628:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789127211.767860:0:7628:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789127211.767861:0:7628:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789127211.767864:0:7628:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:1.0:1789127211.767866:0:7628:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789127211.767867:0:7628:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789127211.767868:0:7628:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789127211.767869:0:7628:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789127211.767870:0:7628:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789127211.767871:0:7628:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789127211.767872:0:7628:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789127211.767873:0:7628:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789127211.767874:0:7628:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789127211.767875:0:7628:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789127211.767876:0:7628:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789127211.767900:0:7628:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1789127211.767915:0:7628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a3a2940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:7628:1876035752703616:0@lo:253: 00000100:00100000:1.0:1789127211.767987:0:7628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127211.768069:0:7628:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df788128900 going to sleep for 11 seconds 00000100:00100000:0.0:1789127211.768113:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752703616 00000100:00100000:0.0:1789127211.768126:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752703616 00000100:00100000:0.0:1789127211.768173:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789127211.768181:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df787bb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+16:7628:x1876035752703616:12345-0@lo:253: 20000000:01000000:0.0:1789127211.768208:0:5822:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1789127211.768211:0:5822:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1789127211.768216:0:5822:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1789127211.768219:0:5822:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1789127211.769784:0:5822:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789127211.770073:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1789127211.770087:0:5822:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1789127211.770122:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1789127211.770129:0:5822:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1789127211.770151:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1789127211.770205:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1789127211.771082:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1789127211.771106:0:5822:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.140@tcp 20000000:01000000:0.0:1789127211.771108:0:5822:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.140@tcp (null) (null) (null) 00000040:00080000:0.0:1789127211.771148:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1789127211.771156:0:5822:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789127211.771205:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1789127211.771213:0:5822:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.206.140@tcp (null) (null) 00000040:00080000:0.0:1789127211.771246:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1789127211.771256:0:5822:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1789127211.771288:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1789127211.771340:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1789127211.772494:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:0.0:1789127211.772519:0:5822:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.140@tcp 20000000:01000000:0.0:1789127211.772521:0:5822:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.140@tcp (null) (null) (null) 00000040:00080000:0.0:1789127211.773092:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:0.0:1789127211.773103:0:5822:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1789127211.773138:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:0.0:1789127211.773156:0:5822:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.206.140@tcp (null) (null) 00000040:00080000:0.0:1789127211.773185:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:0.0:1789127211.773193:0:5822:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1789127211.773237:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:0.0:1789127211.773272:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:0.0:1789127211.773288:0:5822:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:0.0:1789127211.773291:0:5822:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1789127211.773295:0:5822:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1789127211.773307:0:5822:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1789127211.773310:0:5822:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1789127211.773345:0:5822:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1789127211.773347:0:5822:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789127211.774333:0:7630:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1789127211.774391:0:7630:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1789127211.774435:0:7630:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1789127211.775135:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:0.0:1789127211.775172:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:0.0:1789127211.775326:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:0.0:1789127211.775340:0:5822:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1789127211.775343:0:5822:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789127211.776259:0:7631:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 15 1->4: lustre sys.timeout 20000000:01000000:3.0:1789127211.776333:0:7631:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 15 2->4: lustre sys.timeout 00000040:00080000:3.0:1789127211.776363:0:7631:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:0.0:1789127211.776970:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:0.0:1789127211.777007:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:0.0:1789127211.777052:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:0.0:1789127211.777064:0:5822:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1789127211.777066:0:5822:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1789127211.777387:0:7632:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1789127211.777940:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1789127211.777985:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1789127211.778049:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:0.0:1789127211.778063:0:5822:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1789127211.778065:0:5822:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789127211.779918:0:7633:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 16 1->4: lustre sys.timeout 20000000:01000000:3.0:1789127211.780024:0:7633:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 16 2->4: lustre sys.timeout 00000040:00080000:3.0:1789127211.780081:0:7633:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:0.0:1789127211.780408:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:0.0:1789127211.780441:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:0.0:1789127211.780495:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:0.0:1789127211.780508:0:5822:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:0.0:1789127211.780511:0:5822:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:0.0:1789127211.780519:0:5822:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789127211.780728:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8df780031600/0xeeacf7c0243002c1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127211.780747:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df780031800/0xeeacf7c024300212 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c02430020b expref: 16 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127211.780755:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df798df0a00/0xeeacf7c02430023c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c024300235 expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127211.780762:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df780030600/0xeeacf7c024300266 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c02430025f expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127211.780769:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df7c2051c00/0xeeacf7c024300282 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c02430027b expref: 16 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127211.780775:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df7c2172a00/0xeeacf7c0243002ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c0243002a5 expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127211.780782:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8df780031600/0xeeacf7c0243002c1 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127211.780911:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df7c2172a00/0xeeacf7c0243002ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xeeacf7c0243002a5 expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127211.780925:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df7c2172a00/0xeeacf7c0243002ac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xeeacf7c0243002a5 expref: 16 pid: 5825 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127211.780938:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7aeae4000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5822:1876035752703744:0@lo:104: 00000100:00100000:0.0:1789127211.780997:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789127211.781089:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df7c2051c00/0xeeacf7c024300282 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xeeacf7c02430027b expref: 16 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127211.781106:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df7c2051c00/0xeeacf7c024300282 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xeeacf7c02430027b expref: 16 pid: 5822 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127211.781114:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7aeae43c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5822:1876035752703872:0@lo:104: 00010000:00010000:0.0:1789127211.781137:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df780030600/0xeeacf7c024300266 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xeeacf7c02430025f expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127211.781145:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df780030600/0xeeacf7c024300266 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xeeacf7c02430025f expref: 16 pid: 5825 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127211.781152:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7aeae6940 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5822:1876035752704000:0@lo:104: 00010000:00010000:0.0:1789127211.781167:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df798df0a00/0xeeacf7c02430023c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xeeacf7c024300235 expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127211.781175:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df798df0a00/0xeeacf7c02430023c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xeeacf7c024300235 expref: 16 pid: 5825 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127211.781182:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7aeae5680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5822:1876035752704128:0@lo:104: 00010000:00010000:0.0:1789127211.781196:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df780031800/0xeeacf7c024300212 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xeeacf7c02430020b expref: 16 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127211.781203:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df780031800/0xeeacf7c024300212 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xeeacf7c02430020b expref: 16 pid: 5822 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127211.781210:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7aeae4780 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5822:1876035752704256:0@lo:104: 00000100:00100000:0.0:1789127211.781222:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7988fb000 going to sleep for 11 seconds 00000100:00100000:2.0:1789127211.781298:0:5813:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789127211.781318:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127211.781369:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127211.781411:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127211.781427:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752703744 00000100:00100000:3.0:1789127211.781433:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752703744 00000100:00100000:3.0:1789127211.781466:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752703872 00000100:00100000:3.0:1789127211.781468:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752703872 00000100:00100000:3.0:1789127211.781476:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752704000 00000100:00100000:3.0:1789127211.781478:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752704000 00000100:00100000:3.0:1789127211.781488:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789127211.781495:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df790c03c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+5:5822:x1876035752703744:12345-0@lo:104: 00010000:00010000:3.0:1789127211.781507:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.140@tcp lock: ffff8df798df0800/0xeeacf7c0243002a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xeeacf7c0243002ac expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127211.781616:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789127211.781622:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df790c03c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+5:5822:x1876035752703744:12345-0@lo:104: Request processed in 128us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127211.781636:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789127211.781682:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789127211.781688:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79a387480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+4:5822:x1876035752703872:12345-0@lo:104: 00010000:00010000:3.0:1789127211.781695:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.140@tcp lock: ffff8df7c2173200/0xeeacf7c02430027b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xeeacf7c024300282 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127211.781776:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7aeae4000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5822:1876035752703744:0@lo:104: 00000100:00100000:0.0:1789127211.781810:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7aeae43c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5822:1876035752703872:0@lo:104: 00000100:00100000:2.0:1789127211.782329:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127211.782341:0:5813:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:2.0:1789127211.782348:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:0.0:1789127211.782843:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752704128 00000100:00100000:0.0:1789127211.782850:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752704128 00000100:00100000:0.0:1789127211.782882:0:5813:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:0.0:1789127211.782886:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752704256 00000100:00100000:0.0:1789127211.782888:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752704256 00000100:00100000:2.0:1789127211.782976:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789127211.782984:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79a385e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+6:5822:x1876035752704000:12345-0@lo:104: 00010000:00010000:2.0:1789127211.782995:0:7634:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.140@tcp lock: ffff8df7c2051000/0xeeacf7c02430025f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xeeacf7c024300266 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127211.783089:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7aeae6940 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5822:1876035752704000:0@lo:104: 00010000:00010000:1.0:1789127211.783159:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789127211.783167:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.140@tcp lock: ffff8df798df0800/0xeeacf7c0243002a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xeeacf7c0243002ac expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127211.783181:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df798df0800 already unused, calling callback (ffffffffc1da1c20) 10000000:00010000:1.0:1789127211.783185:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.140@tcp lock: ffff8df798df0800/0xeeacf7c0243002a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xeeacf7c0243002ac expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127211.783192:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: ffff8df798df0800/0xeeacf7c0243002a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xeeacf7c0243002ac expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789127211.783198:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: ffff8df798df0800/0xeeacf7c0243002a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xeeacf7c0243002ac expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789127211.783203:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789127211.783234:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.140@tcp lock: ffff8df798df0800/0xeeacf7c0243002a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c0243002ac expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127211.783241:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789127211.783256:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.140@tcp lock: ffff8df798df0800/0xeeacf7c0243002a5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c0243002ac expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127211.783262:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: ffff8df798df0800/0xeeacf7c0243002a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c0243002ac expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127211.783275:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789127211.783278:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.140@tcp lock: ffff8df7c2173200/0xeeacf7c02430027b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xeeacf7c024300282 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127211.783283:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7c2173200 already unused, calling callback (ffffffffc1da1c20) 10000000:00010000:1.0:1789127211.783286:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.140@tcp lock: ffff8df7c2173200/0xeeacf7c02430027b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xeeacf7c024300282 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127211.783301:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: ffff8df7c2173200/0xeeacf7c02430027b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xeeacf7c024300282 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789127211.783308:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: ffff8df7c2173200/0xeeacf7c02430027b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xeeacf7c024300282 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789127211.783313:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789127211.783326:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.140@tcp lock: ffff8df7c2173200/0xeeacf7c02430027b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c024300282 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127211.783330:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789127211.783335:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.140@tcp lock: ffff8df7c2173200/0xeeacf7c02430027b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c024300282 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127211.783340:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: ffff8df7c2173200/0xeeacf7c02430027b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c024300282 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127211.783348:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789127211.783351:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.140@tcp lock: ffff8df7c2051000/0xeeacf7c02430025f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xeeacf7c024300266 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127211.783356:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7c2051000 already unused, calling callback (ffffffffc1da1c20) 10000000:00010000:1.0:1789127211.783358:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.140@tcp lock: ffff8df7c2051000/0xeeacf7c02430025f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xeeacf7c024300266 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127211.783364:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: ffff8df7c2051000/0xeeacf7c02430025f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xeeacf7c024300266 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789127211.783369:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: ffff8df7c2051000/0xeeacf7c02430025f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xeeacf7c024300266 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789127211.783378:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789127211.783389:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.140@tcp lock: ffff8df7c2051000/0xeeacf7c02430025f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c024300266 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127211.783393:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789127211.783405:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.140@tcp lock: ffff8df7c2051000/0xeeacf7c02430025f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c024300266 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127211.783411:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: ffff8df7c2051000/0xeeacf7c02430025f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c024300266 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127211.783420:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127211.783421:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127211.783423:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127211.783450:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a3a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3300:1876035752704384:0@lo:103: 00000100:00100000:1.0:1789127211.783483:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127211.783515:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789127211.783520:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a3a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3300:1876035752704512:0@lo:103: 00000100:00100000:1.0:1789127211.783575:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127211.783613:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a3a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3302:1876035752704640:0@lo:103: 00000100:00100000:1.0:1789127211.783966:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127211.784007:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752704384 00000100:00100000:1.0:1789127211.784012:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752704384 00010000:00010000:1.0:1789127211.784032:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df7c2172a00/0xeeacf7c0243002ac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xeeacf7c0243002a5 expref: 17 pid: 5825 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127211.784046:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752704512 00000100:00100000:1.0:1789127211.784047:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752704512 00010000:00010000:1.0:1789127211.784064:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df7c2051c00/0xeeacf7c024300282 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xeeacf7c02430027b expref: 18 pid: 5822 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127211.784072:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752704640 00000100:00100000:1.0:1789127211.784074:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752704640 00010000:00010000:1.0:1789127211.784081:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df780030600/0xeeacf7c024300266 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xeeacf7c02430025f expref: 19 pid: 5825 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127211.784090:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789127211.784094:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79a3a2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:3300:x1876035752704384:12345-0@lo:103: 00010000:00010000:1.0:1789127211.784103:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789127211.784108:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df7c2172a00/0xeeacf7c0243002ac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xeeacf7c0243002a5 expref: 19 pid: 5825 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127211.784117:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df7c2172a00/0xeeacf7c0243002ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xeeacf7c0243002a5 expref: 19 pid: 5825 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127211.784130:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df7c2172a00/0xeeacf7c0243002ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xeeacf7c0243002a5 expref: 19 pid: 5825 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127211.784143:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789127211.784171:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79a3a2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+18:3300:x1876035752704384:12345-0@lo:103: Request processed in 76us (687us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127211.784176:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789127211.784189:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789127211.784193:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bfc48000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+17:3300:x1876035752704512:12345-0@lo:103: 00010000:00010000:1.0:1789127211.784200:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789127211.784203:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df7c2051c00/0xeeacf7c024300282 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xeeacf7c02430027b expref: 17 pid: 5822 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127211.784221:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df7c2051c00/0xeeacf7c024300282 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xeeacf7c02430027b expref: 17 pid: 5822 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127211.784230:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df7c2051c00/0xeeacf7c024300282 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xeeacf7c02430027b expref: 17 pid: 5822 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127211.784237:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789127211.784256:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bfc48000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+16:3300:x1876035752704512:12345-0@lo:103: Request processed in 62us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127211.784261:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789127211.784270:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789127211.784275:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bfc483c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+15:3302:x1876035752704640:12345-0@lo:103: 00010000:00010000:1.0:1789127211.784281:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789127211.784284:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df780030600/0xeeacf7c024300266 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xeeacf7c02430025f expref: 15 pid: 5825 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127211.784291:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df780030600/0xeeacf7c024300266 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xeeacf7c02430025f expref: 15 pid: 5825 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127211.784301:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df780030600/0xeeacf7c024300266 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xeeacf7c02430025f expref: 15 pid: 5825 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127211.784309:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789127211.784334:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bfc483c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+14:3302:x1876035752704640:12345-0@lo:103: Request processed in 58us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127211.784339:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789127211.784364:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a3a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3302:1876035752704640:0@lo:103: 00000100:00100000:1.0:1789127211.784384:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a3a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3300:1876035752704512:0@lo:103: 00000100:00100000:1.0:1789127211.784397:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a3a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3300:1876035752704384:0@lo:103: 00010000:00010000:3.0:1789127211.784532:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:3.0:1789127211.784540:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79a387480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+6:5822:x1876035752703872:12345-0@lo:104: Request processed in 2852us (3221us total) trans 0 rc 0/0 00010000:00010000:0.0:1789127211.784729:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127211.784755:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789127211.784776:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789127211.784784:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79a385a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+5:5822:x1876035752704128:12345-0@lo:104: 00010000:00010000:3.0:1789127211.784821:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.140@tcp lock: ffff8df798df1000/0xeeacf7c024300235 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xeeacf7c02430023c expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127211.784865:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789127211.784869:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79a385a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+5:5822:x1876035752704128:12345-0@lo:104: Request processed in 88us (3458us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127211.784874:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789127211.784887:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789127211.784892:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79a384780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+4:5822:x1876035752704256:12345-0@lo:104: 00010000:00010000:3.0:1789127211.784899:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.140@tcp lock: ffff8df7c2051200/0xeeacf7c02430020b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xeeacf7c024300212 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127211.784926:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789127211.784930:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79a384780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+4:5822:x1876035752704256:12345-0@lo:104: Request processed in 39us (2605us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127211.784934:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1789127211.784960:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789127211.784964:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.140@tcp lock: ffff8df798df1000/0xeeacf7c024300235 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xeeacf7c02430023c expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127211.784971:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df798df1000 already unused, calling callback (ffffffffc1da1c20) 10000000:00010000:3.0:1789127211.784974:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.140@tcp lock: ffff8df798df1000/0xeeacf7c024300235 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xeeacf7c02430023c expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127211.784991:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: ffff8df798df1000/0xeeacf7c024300235 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xeeacf7c02430023c expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789127211.784997:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: ffff8df798df1000/0xeeacf7c024300235 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xeeacf7c02430023c expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127211.785002:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789127211.785026:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.140@tcp lock: ffff8df798df1000/0xeeacf7c024300235 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c02430023c expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127211.785031:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789127211.785041:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.140@tcp lock: ffff8df798df1000/0xeeacf7c024300235 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c02430023c expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127211.785047:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: ffff8df798df1000/0xeeacf7c024300235 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c02430023c expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127211.785056:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789127211.785059:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.140@tcp lock: ffff8df7c2051200/0xeeacf7c02430020b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xeeacf7c024300212 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127211.785063:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7c2051200 already unused, calling callback (ffffffffc1da1c20) 10000000:00010000:3.0:1789127211.785066:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.140@tcp lock: ffff8df7c2051200/0xeeacf7c02430020b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xeeacf7c024300212 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127211.785071:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: ffff8df7c2051200/0xeeacf7c02430020b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xeeacf7c024300212 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789127211.785076:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: ffff8df7c2051200/0xeeacf7c02430020b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xeeacf7c024300212 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127211.785086:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789127211.785097:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.140@tcp lock: ffff8df7c2051200/0xeeacf7c02430020b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c024300212 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127211.785101:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789127211.785108:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.140@tcp lock: ffff8df7c2051200/0xeeacf7c02430020b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c024300212 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127211.785114:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: ffff8df7c2051200/0xeeacf7c02430020b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c024300212 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127211.785125:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127211.785126:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127211.785128:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127211.785190:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7aeae5680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5822:1876035752704128:0@lo:104: 00000100:00100000:0.0:1789127211.785199:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7aeae4780 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5822:1876035752704256:0@lo:104: 00010000:00010000:0.0:1789127211.785225:0:5822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8df780031600/0xeeacf7c0243002c1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127211.785296:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789127211.785308:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a2c52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3301:1876035752704896:0@lo:103: 00000100:00100000:1.0:1789127211.785342:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127211.785390:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a2c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3303:1876035752704768:0@lo:103: 00000100:00100000:1.0:1789127211.785414:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789127211.785493:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127211.785618:0:7634:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1789127211.785626:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79a385e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+3:5822:x1876035752704000:12345-0@lo:104: Request processed in 2642us (4256us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127211.785643:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1789127211.785847:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127211.786037:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752704896 00000100:00100000:1.0:1789127211.786044:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752704896 00010000:00010000:1.0:1789127211.786069:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df780031800/0xeeacf7c024300212 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xeeacf7c02430020b expref: 14 pid: 5822 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127211.786098:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752704768 00000100:00100000:1.0:1789127211.786101:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752704768 00010000:00010000:1.0:1789127211.786112:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df798df0a00/0xeeacf7c02430023c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xeeacf7c024300235 expref: 15 pid: 5825 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127211.786125:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789127211.786133:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bfc4a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+15:3301:x1876035752704896:12345-0@lo:103: 00010000:00010000:1.0:1789127211.786144:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789127211.786149:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df780031800/0xeeacf7c024300212 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xeeacf7c02430020b expref: 15 pid: 5822 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127211.786158:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df780031800/0xeeacf7c024300212 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xeeacf7c02430020b expref: 15 pid: 5822 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127211.786173:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df780031800/0xeeacf7c024300212 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xeeacf7c02430020b expref: 15 pid: 5822 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127211.786201:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789127211.786248:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bfc4a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+14:3301:x1876035752704896:12345-0@lo:103: Request processed in 116us (904us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127211.786254:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789127211.786268:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789127211.786274:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bfc49680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+13:3303:x1876035752704768:12345-0@lo:103: 00010000:00010000:1.0:1789127211.786282:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789127211.786286:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df798df0a00/0xeeacf7c02430023c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xeeacf7c024300235 expref: 13 pid: 5825 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127211.786296:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df798df0a00/0xeeacf7c02430023c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xeeacf7c024300235 expref: 13 pid: 5825 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127211.786311:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df798df0a00/0xeeacf7c02430023c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xeeacf7c024300235 expref: 13 pid: 5825 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127211.786325:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8df780031600/0xeeacf7c0243002c1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127211.786333:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df780031600/0xeeacf7c0243002c1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127211.786346:0:5816:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df780031600/0xeeacf7c0243002c1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127211.786353:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df780031600/0xeeacf7c0243002c1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127211.786359:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8df780031600/0xeeacf7c0243002c1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127211.786371:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8df780031600/0xeeacf7c0243002c1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127211.786377:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df780031600 already unused, calling callback (ffffffffc17a4550) 00010000:00010000:1.0:1789127211.786381:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8df780031600/0xeeacf7c0243002c1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127211.786389:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8df780031600/0xeeacf7c0243002c1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127211.786401:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8df780031600/0xeeacf7c0243002c1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127211.786411:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789127211.786440:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bfc49680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+12:3303:x1876035752704768:12345-0@lo:103: Request processed in 166us (1025us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127211.786446:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789127211.786478:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a2c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3303:1876035752704768:0@lo:103: 00000100:00100000:2.0:1789127211.786783:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a2c52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3301:1876035752704896:0@lo:103: 00010000:00010000:0.0:1789127211.787042:0:5822:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8df780031600/0xeeacf7c0243002c1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127211.787051:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8df780031600/0xeeacf7c0243002c1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127211.787056:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df780031600/0xeeacf7c0243002c1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789127211.787070:0:5822:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1789127211.830468:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df787bb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+11:7628:x1876035752703616:12345-0@lo:253: Request processed in 62279us (62472us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127211.830484:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789127211.830605:0:7628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a3a2940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:7628:1876035752703616:0@lo:253: 10000000:01000000:1.0:1789127211.830620:0:7628:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1789127211.830623:0:7628:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789127211.830625:0:7628:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789127211.830626:0:7628:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789127211.830627:0:7628:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:1.0:1789127211.830751:0:7628:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789127211.830753:0:7628:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789127211.830754:0:7628:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789127211.830755:0:7628:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1789127211.830757:0:7628:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789127211.830758:0:7628:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789127211.830822:0:7628:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8df7b45fe800 from lustre-OST0001 10000000:01000000:1.0:1789127211.830849:0:7628:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1789127211.830852:0:7628:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1789127211.830860:0:7628:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8df790d38000 local copy 10000000:01000000:1.0:1789127211.830864:0:7628:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789127211.830900:0:7628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df7c2051c00/0xeeacf7c0243002c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127211.830911:0:7628:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.140@tcp lock: ffff8df7c2051c00/0xeeacf7c0243002c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127211.830920:0:7628:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff8df7c2051c00/0xeeacf7c0243002c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127211.830939:0:7628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7bfc48780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:7628:1876035752705024:0@lo:101: 00000100:00100000:1.0:1789127211.830974:0:7628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127211.831004:0:7628:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df788128480 going to sleep for 11 seconds 00000100:00100000:0.0:1789127211.831059:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752705024 00000100:00100000:0.0:1789127211.831065:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752705024 00000100:00100000:0.0:1789127211.831110:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789127211.831119:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df787bbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+11:7628:x1876035752705024:12345-0@lo:101: 00010000:00010000:0.0:1789127211.831138:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127211.831151:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df780031600/0xeeacf7c0243002cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xeeacf7c0243002c8 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127211.831173:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df780031600/0xeeacf7c0243002cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xeeacf7c0243002c8 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127211.831184:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df780031600/0xeeacf7c0243002cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c0243002c8 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127211.831192:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df780031600, rc 0) 00000100:00100000:0.0:1789127211.831223:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df787bbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+12:7628:x1876035752705024:12345-0@lo:101: Request processed in 105us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127211.831230:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789127211.831434:0:7628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7bfc48780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:7628:1876035752705024:0@lo:101: 00010000:00010000:1.0:1789127211.831447:0:7628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff8df7c2051c00/0xeeacf7c0243002c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xeeacf7c0243002cf expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127211.831456:0:7628:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff8df7c2051c00/0xeeacf7c0243002c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xeeacf7c0243002cf expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127211.831540:0:7628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7bfc48780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:7628:1876035752705152:0@lo:501: 00000100:00100000:1.0:1789127211.831988:0:7628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127211.832010:0:7628:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df788128480 going to sleep for 11 seconds 00000100:00100000:0.0:1789127211.832141:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752705152 00000100:00100000:0.0:1789127211.832147:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752705152 00000100:00100000:0.0:1789127211.832184:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789127211.832192:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df787bba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+12:7628:x1876035752705152:12345-0@lo:501: 00000100:00100000:0.0:1789127211.832911:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df787bba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+12:7628:x1876035752705152:12345-0@lo:501: Request processed in 717us (920us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789127211.832919:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789127211.833483:0:7628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7bfc48780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:7628:1876035752705152:0@lo:501: 10000000:01000000:1.0:1789127211.833501:0:7628:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.140@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789127211.833544:0:7628:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.140@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789127211.833739:0:7628:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df7c2051c00/0xeeacf7c0243002c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xeeacf7c0243002cf expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127211.833751:0:7628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df7c2051c00/0xeeacf7c0243002c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xeeacf7c0243002cf expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127211.833758:0:7628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.140@tcp lock: ffff8df7c2051c00/0xeeacf7c0243002c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xeeacf7c0243002cf expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127211.833776:0:7628:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789127211.833878:0:7628:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8df7b45fe800 10000000:01000000:1.0:1789127211.833884:0:7628:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789127211.833889:0:7628:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1789127211.833892:0:7628:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789127211.833896:0:7628:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1789127211.833899:0:7628:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1789127211.833925:0:7628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df7c2051000/0xeeacf7c0243002d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127211.833932:0:7628:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff8df7c2051000/0xeeacf7c0243002d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127211.833940:0:7628:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff8df7c2051000/0xeeacf7c0243002d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127211.833957:0:7628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7bfc48780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:7628:1876035752705280:0@lo:101: 00000100:00100000:1.0:1789127211.833997:0:7628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789127211.834075:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789127211.834081:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.140@tcp lock: ffff8df7c2051c00/0xeeacf7c0243002c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xeeacf7c0243002cf expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127211.834088:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7c2051c00 already unused, calling callback (ffffffffc1da1c20) 10000000:00010000:0.0:1789127211.834092:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.140@tcp lock: ffff8df7c2051c00/0xeeacf7c0243002c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xeeacf7c0243002cf expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127211.834112:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: ffff8df7c2051c00/0xeeacf7c0243002c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xeeacf7c0243002cf expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789127211.834119:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: ffff8df7c2051c00/0xeeacf7c0243002c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xeeacf7c0243002cf expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127211.834126:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789127211.834144:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.140@tcp lock: ffff8df7c2051c00/0xeeacf7c0243002c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xeeacf7c0243002cf expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127211.834151:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789127211.834169:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.140@tcp lock: ffff8df7c2051c00/0xeeacf7c0243002c8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xeeacf7c0243002cf expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127211.834176:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: ffff8df7c2051c00/0xeeacf7c0243002c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xeeacf7c0243002cf expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127211.834188:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127211.834190:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127211.834192:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127211.834309:0:7628:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df788128f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789127211.834325:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789127211.834345:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7aeae4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3300:1876035752705408:0@lo:103: 00000100:00100000:1.0:1789127211.834375:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127211.834442:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752705408 00000100:00100000:0.0:1789127211.834448:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752705408 00000100:00100000:0.0:1789127211.834499:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789127211.834508:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bfc4a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+12:3300:x1876035752705408:12345-0@lo:103: 00010000:00010000:0.0:1789127211.834519:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789127211.834534:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df780031600/0xeeacf7c0243002cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xeeacf7c0243002c8 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127211.834563:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789127211.834618:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bfc4a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+11:3300:x1876035752705408:12345-0@lo:103: Request processed in 111us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127211.834626:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789127211.834844:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7aeae4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3300:1876035752705408:0@lo:103: 00000100:00100000:2.0:1789127211.835208:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752705280 00000100:00100000:2.0:1789127211.835214:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752705280 00000100:00100000:2.0:1789127211.835359:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789127211.835375:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df787bb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+11:7628:x1876035752705280:12345-0@lo:101: 00010000:00010000:2.0:1789127211.835387:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127211.835401:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df7c2173000/0xeeacf7c0243002dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xeeacf7c0243002d6 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127211.835423:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df7c2173000/0xeeacf7c0243002dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xeeacf7c0243002d6 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127211.835434:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df7c2173000/0xeeacf7c0243002dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c0243002d6 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127211.835442:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7c2173000, rc 0) 00000100:00100000:2.0:1789127211.835494:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df787bb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+12:7628:x1876035752705280:12345-0@lo:101: Request processed in 120us (1496us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127211.835501:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789127211.835598:0:7628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7bfc48780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:7628:1876035752705280:0@lo:101: 00010000:00010000:3.0:1789127211.835613:0:7628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff8df7c2051000/0xeeacf7c0243002d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c0243002dd expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127211.835624:0:7628:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff8df7c2051000/0xeeacf7c0243002d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xeeacf7c0243002dd expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127211.835735:0:7628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a2c61c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:7628:1876035752705536:0@lo:501: 00000100:00100000:3.0:1789127211.835779:0:7628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127211.836199:0:7628:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df790702cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789127211.836334:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752705536 00000100:00100000:1.0:1789127211.836340:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752705536 00000100:00100000:1.0:1789127211.836367:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789127211.836374:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df788035050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+12:7628:x1876035752705536:12345-0@lo:501: 00000100:00100000:1.0:1789127211.836818:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df788035050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+12:7628:x1876035752705536:12345-0@lo:501: Request processed in 442us (1037us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127211.836826:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789127211.836941:0:7628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a2c61c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:7628:1876035752705536:0@lo:501: 00000100:00100000:3.0:1789127211.836979:0:7628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a2c61c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:7628:1876035752705664:0@lo:503: 00000100:00100000:3.0:1789127211.837021:0:7628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127211.837059:0:7628:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df790702cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789127211.837109:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752705664 00000100:00100000:2.0:1789127211.837114:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752705664 00000100:00100000:2.0:1789127211.837137:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789127211.837142:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df788035850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+12:7628:x1876035752705664:12345-0@lo:503: 00000100:00100000:2.0:1789127211.837356:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df788035850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+12:7628:x1876035752705664:12345-0@lo:503: Request processed in 213us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127211.837363:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789127211.837438:0:7628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a2c61c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:7628:1876035752705664:0@lo:503: 00000040:00080000:3.0:1789127211.837899:0:7628:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789127211.837952:0:7628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a2c61c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:7628:1876035752705792:0@lo:502: 00000100:00100000:3.0:1789127211.837990:0:7628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127211.838014:0:7628:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df790702cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789127211.838088:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752705792 00000100:00100000:1.0:1789127211.838092:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752705792 00000100:00100000:1.0:1789127211.838113:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789127211.838119:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df788034050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+12:7628:x1876035752705792:12345-0@lo:502: 00000100:00100000:1.0:1789127211.839016:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df788034050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+12:7628:x1876035752705792:12345-0@lo:502: Request processed in 893us (1022us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127211.839025:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789127211.839138:0:7628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a2c61c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:7628:1876035752705792:0@lo:502: 00000040:00080000:3.0:1789127211.839409:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1789127211.839458:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1789127211.839490:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1789127211.839567:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1789127211.839836:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1789127211.839875:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1789127211.839908:0:7628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a2c61c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:7628:1876035752705920:0@lo:502: 00000100:00100000:3.0:1789127211.839957:0:7628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127211.839991:0:7628:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df790702cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789127211.840080:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752705920 00000100:00100000:2.0:1789127211.840086:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752705920 00000100:00100000:2.0:1789127211.840118:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789127211.840127:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df788035450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+12:7628:x1876035752705920:12345-0@lo:502: 00000100:00100000:2.0:1789127211.840458:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df788035450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+12:7628:x1876035752705920:12345-0@lo:502: Request processed in 330us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127211.840473:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789127211.841112:0:7628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a2c61c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:7628:1876035752705920:0@lo:502: 00000040:00080000:3.0:1789127211.841240:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1789127211.841252:0:7628:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:0.0:1789127211.842285:0:7637:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789127211.842294:0:7637:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1789127211.842302:0:7637:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127211.842304:0:7637:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1789127211.842310:0:7637:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789127211.842326:0:7637:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8df7af709a48) 00000020:00000080:0.0:1789127211.842349:0:7637:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:0.0:1789127211.842354:0:7637:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789127211.842414:0:7637:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8df7b45fe800 from lustre-OST0001, refs=2 00080000:01000000:0.0:1789127211.842423:0:7637:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789127211.842434:0:7637:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xeeacf7c0243002eb 00010000:00010000:0.0:1789127211.846847:0:7637:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:0.0:1789127211.847176:0:7637:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:0.0:1789127211.857059:0:7637:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1789127211.857371:0:7637:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:0.0:1789127211.863518:0:7637:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1789127211.865045:0:7637:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1789127211.872944:0:7637:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1789127211.872959:0:7637:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789127211.872965:0:7637:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127211.872967:0:7637:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1789127211.872970:0:7637:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789127211.872974:0:7637:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127211.872975:0:7637:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789127211.872977:0:7637:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789127211.872979:0:7637:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789127211.873016:0:7637:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789127211.873018:0:7637:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127211.873019:0:7637:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789127211.873029:0:7637:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1789127211.873283:0:7628:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:2.0:1789127211.873311:0:7628:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1789127211.873334:0:7628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df7c2051000/0xeeacf7c0243002d6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c0243002dd expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127211.873345:0:7628:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff8df7c2051000/0xeeacf7c0243002d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c0243002dd expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127211.873351:0:7628:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df7b45fe800 from 1 10000000:01000000:2.0:1789127211.873354:0:7628:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789127211.873391:0:7628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df7c2172a00/0xeeacf7c0243002f2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127211.873399:0:7628:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff8df7c2172a00/0xeeacf7c0243002f2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127211.873412:0:7628:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff8df7c2172a00/0xeeacf7c0243002f2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127211.873438:0:7628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a3861c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:7628:1876035752706048:0@lo:101: 00000100:00100000:2.0:1789127211.873518:0:7628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127211.875425:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752706048 00000100:00100000:2.0:1789127211.875437:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752706048 00000100:00100000:2.0:1789127211.875505:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789127211.875514:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df788036c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+12:7628:x1876035752706048:12345-0@lo:101: 00010000:00010000:2.0:1789127211.875529:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127211.875545:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df7c2173200/0xeeacf7c0243002f9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xeeacf7c0243002f2 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127211.875721:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df7c2173200/0xeeacf7c0243002f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xeeacf7c0243002f2 expref: 13 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127211.875731:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df7c2173200/0xeeacf7c0243002f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c0243002f2 expref: 13 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127211.875740:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7c2173200, rc 0) 00000100:00100000:2.0:1789127211.875827:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df788036c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+13:7628:x1876035752706048:12345-0@lo:101: Request processed in 313us (2309us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127211.875833:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789127211.875893:0:7628:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7aea33840 going to sleep for 11 seconds 00000100:00100000:2.0:1789127211.875917:0:7628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a3861c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:7628:1876035752706048:0@lo:101: 00010000:00010000:2.0:1789127211.875933:0:7628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff8df7c2172a00/0xeeacf7c0243002f2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c0243002f9 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127211.875941:0:7628:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff8df7c2172a00/0xeeacf7c0243002f2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xeeacf7c0243002f9 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127211.876043:0:7628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a3861c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:7628:1876035752706176:0@lo:501: 00000100:00100000:2.0:1789127211.876072:0:7628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127211.876099:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752706176 00000100:00100000:2.0:1789127211.876103:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752706176 00000100:00100000:2.0:1789127211.876122:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789127211.876127:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df788036850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+13:7628:x1876035752706176:12345-0@lo:501: 00000100:00100000:3.0:1789127211.877934:0:7628:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7aea33840 going to sleep for 11 seconds 00000100:00100000:2.0:1789127211.878900:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df788036850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+13:7628:x1876035752706176:12345-0@lo:501: Request processed in 2768us (2822us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127211.878912:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789127211.884344:0:7628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a3861c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:7628:1876035752706176:0@lo:501: 00000100:00100000:2.0:1789127211.884478:0:7628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a3861c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:7628:1876035752706304:0@lo:503: 00000100:00100000:2.0:1789127211.884592:0:7628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127211.884665:0:7628:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7aea33f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789127211.886764:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752706304 00000100:00100000:0.0:1789127211.886776:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752706304 00000100:00100000:2.0:1789127211.887936:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789127211.887946:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df788035c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+13:7628:x1876035752706304:12345-0@lo:503: 00000100:00100000:2.0:1789127211.888324:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df788035c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+13:7628:x1876035752706304:12345-0@lo:503: Request processed in 377us (3731us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127211.888332:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789127211.888849:0:7628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a3861c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:7628:1876035752706304:0@lo:503: 00000040:00080000:1.0:1789127211.889135:0:7628:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789127211.889215:0:7628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7bfc4b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:7628:1876035752706432:0@lo:502: 00000100:00100000:1.0:1789127211.889265:0:7628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127211.889300:0:7628:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7881283c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789127211.890627:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752706432 00000100:00100000:2.0:1789127211.890637:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752706432 00000100:00100000:2.0:1789127211.890689:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789127211.890699:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df788036450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+13:7628:x1876035752706432:12345-0@lo:502: 00000100:00100000:2.0:1789127211.890965:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df788036450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+13:7628:x1876035752706432:12345-0@lo:502: Request processed in 267us (1699us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127211.890971:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789127211.891141:0:7628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7bfc4b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:7628:1876035752706432:0@lo:502: 00000040:00080000:0.0:1789127211.891437:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1789127211.891484:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1789127211.891511:0:7628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7aeae5680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:7628:1876035752706560:0@lo:502: 00000100:00100000:0.0:1789127211.891551:0:7628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127211.891596:0:7628:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df790205e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789127211.892200:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752706560 00000100:00100000:1.0:1789127211.892207:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752706560 00000100:00100000:1.0:1789127211.892253:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789127211.892261:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df788034c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+13:7628:x1876035752706560:12345-0@lo:502: 00000100:00100000:1.0:1789127211.892440:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df788034c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+13:7628:x1876035752706560:12345-0@lo:502: Request processed in 179us (887us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127211.892447:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789127211.892546:0:7628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7aeae5680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:7628:1876035752706560:0@lo:502: 00000040:00080000:0.0:1789127211.892781:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1789127211.892822:0:7628:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1789127211.894500:0:7641:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789127211.894513:0:7641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127211.894515:0:7641:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789127211.894524:0:7641:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8df7b45fe800 00000020:00000080:3.0:1789127211.894527:0:7641:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789127211.894727:0:7641:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789127211.894732:0:7641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127211.894742:0:7641:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1789127211.894746:0:7641:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1789127211.895051:0:7628:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1789127211.895079:0:7628:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789127211.895103:0:7628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df7c2172a00/0xeeacf7c0243002f2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c0243002f9 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127211.895114:0:7628:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff8df7c2172a00/0xeeacf7c0243002f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c0243002f9 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127211.895156:0:7628:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789127211.895159:0:7628:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8df7b45fe800 10000000:01000000:0.0:1789127211.895163:0:7628:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8df7b45fe800 10000000:01000000:0.0:1789127211.895166:0:7628:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789127211.895171:0:7628:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8df7b45fe800 from 1 10000000:01000000:0.0:1789127211.895175:0:7628:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789127211.895214:0:7628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df780031600/0xeeacf7c024300300 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127211.895222:0:7628:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff8df780031600/0xeeacf7c024300300 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127211.895241:0:7628:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff8df780031600/0xeeacf7c024300300 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127211.895265:0:7628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7aeae5680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:7628:1876035752706688:0@lo:101: 00000100:00100000:0.0:1789127211.895334:0:7628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127211.895385:0:7628:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df790205c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789127211.895436:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752706688 00000100:00100000:3.0:1789127211.895443:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752706688 00000100:00100000:3.0:1789127211.895494:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789127211.895503:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df788037c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+13:7628:x1876035752706688:12345-0@lo:101: 00010000:00010000:3.0:1789127211.895517:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127211.895532:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df798df1000/0xeeacf7c024300307 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xeeacf7c024300300 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127211.895574:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df798df1000/0xeeacf7c024300307 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xeeacf7c024300300 expref: 14 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127211.895594:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df798df1000/0xeeacf7c024300307 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c024300300 expref: 14 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127211.895603:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df798df1000, rc 0) 00000100:00100000:3.0:1789127211.895649:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df788037c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+14:7628:x1876035752706688:12345-0@lo:101: Request processed in 147us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127211.895656:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789127211.895705:0:7628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7aeae5680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:7628:1876035752706688:0@lo:101: 00010000:00010000:3.0:1789127211.895721:0:7628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff8df780031600/0xeeacf7c024300300 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c024300307 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127211.895730:0:7628:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff8df780031600/0xeeacf7c024300300 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xeeacf7c024300307 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127211.895844:0:7628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a2c61c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:7628:1876035752706816:0@lo:501: 00000100:00100000:3.0:1789127211.895874:0:7628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127211.895910:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752706816 00000100:00100000:3.0:1789127211.895914:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752706816 00000100:00100000:3.0:1789127211.895938:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789127211.895945:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df788036050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+14:7628:x1876035752706816:12345-0@lo:501: 00000100:00100000:3.0:1789127211.896157:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df788036050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+14:7628:x1876035752706816:12345-0@lo:501: Request processed in 212us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127211.896164:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789127211.896189:0:7628:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df790702840 going to sleep for 11 seconds 00000100:00100000:3.0:1789127211.896201:0:7628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a2c61c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:7628:1876035752706816:0@lo:501: 00000100:00100000:3.0:1789127211.896227:0:7628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a2c61c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:7628:1876035752706944:0@lo:503: 00000100:00100000:3.0:1789127211.896265:0:7628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127211.896285:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752706944 00000100:00100000:3.0:1789127211.896289:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752706944 00000100:00100000:3.0:1789127211.896310:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789127211.896315:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df788037450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+14:7628:x1876035752706944:12345-0@lo:503: 00000100:00100000:3.0:1789127211.896444:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df788037450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+14:7628:x1876035752706944:12345-0@lo:503: Request processed in 128us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127211.896450:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789127211.896478:0:7628:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df790702840 going to sleep for 11 seconds 00000100:00100000:3.0:1789127211.896488:0:7628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a2c61c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:7628:1876035752706944:0@lo:503: 00000040:00080000:3.0:1789127211.896758:0:7628:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789127211.896841:0:7628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a2c61c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:7628:1876035752707072:0@lo:502: 00000100:00100000:3.0:1789127211.896876:0:7628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127211.896899:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752707072 00000100:00100000:3.0:1789127211.896903:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752707072 00000100:00100000:3.0:1789127211.896925:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789127211.896931:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df788034450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+14:7628:x1876035752707072:12345-0@lo:502: 00000100:00100000:3.0:1789127211.897085:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df788034450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+14:7628:x1876035752707072:12345-0@lo:502: Request processed in 153us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127211.897094:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789127211.897137:0:7628:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df790702840 going to sleep for 11 seconds 00000100:00100000:3.0:1789127211.897151:0:7628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a2c61c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:7628:1876035752707072:0@lo:502: 00000040:00080000:3.0:1789127211.897426:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1789127211.897470:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1789127211.897505:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1789127211.897555:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1789127211.897608:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1789127211.897660:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1789127211.897697:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1789127211.897731:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1789127211.897784:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1789127211.897847:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1789127211.897883:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1789127211.897934:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1789127211.897974:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1789127211.898028:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1789127211.898084:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1789127211.898122:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1789127211.898161:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1789127211.898216:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1789127211.899144:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1789127211.899210:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1789127211.899271:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1789127211.899311:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1789127211.899346:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1789127211.899401:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1789127211.899452:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1789127211.899498:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1789127211.899702:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1789127211.899741:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:3.0:1789127211.899774:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1789127211.899963:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:2.0:1789127211.900519:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:2.0:1789127211.900574:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:2.0:1789127211.900632:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:2.0:1789127211.900763:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:2.0:1789127211.901023:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:2.0:1789127211.901149:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:2.0:1789127211.901187:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:2.0:1789127211.901237:0:7628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a3852c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:7628:1876035752707200:0@lo:502: 00000100:00100000:2.0:1789127211.905199:0:7628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127211.905262:0:7628:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7aea33e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789127211.905277:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752707200 00000100:00100000:3.0:1789127211.905285:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752707200 00000100:00100000:3.0:1789127211.905344:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789127211.905354:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df788037850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+14:7628:x1876035752707200:12345-0@lo:502: 00000100:00100000:3.0:1789127211.905754:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df788037850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+14:7628:x1876035752707200:12345-0@lo:502: Request processed in 401us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127211.905762:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789127211.907124:0:7628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a3852c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:7628:1876035752707200:0@lo:502: 00000040:00080000:2.0:1789127211.907271:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:2.0:1789127211.907298:0:7628:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1789127211.912640:0:7642:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1789127211.912659:0:7642:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8df790230000) 00000020:00000080:2.0:1789127211.912683:0:7642:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:2.0:1789127211.913681:0:7642:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8df7b45fe800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789127211.914415:0:7642:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8df7b45fe800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789127211.914421:0:7642:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8df7b45fe800 3 00010000:00080000:2.0:1789127211.914466:0:7642:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8df682adb800@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.140@tcp at head 00010000:00010000:2.0:1789127211.919362:0:7642:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:2.0:1789127211.919568:0:7642:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1789127211.919618:0:7642:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789127211.919632:0:7642:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xeeacf7c024300315 00000100:00080000:2.0:1789127211.919641:0:7642:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789127211.919648:0:7642:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8df682adb800 using connection 192.168.206.140@tcp/0@lo 00000100:00100000:2.0:1789127211.919686:0:7642:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df79a3852c0 x1876035752707328/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789127211.919709:0:7642:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789127211.919780:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a3852c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3299:1876035752707328:0@lo:38: 00000100:00100000:0.0:1789127211.919890:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127211.919960:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752707328 00000100:00100000:0.0:1789127211.919969:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752707328 00000100:00100000:0.0:1789127211.920005:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789127211.920013:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeae6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3299:x1876035752707328:12345-0@lo:38: 00010000:00080000:0.0:1789127211.920038:0:5830:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 158 last 0 00000020:00000080:0.0:1789127211.920076:0:5830:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xeeacf7c02430031c 00000004:00100000:0.0:1789127211.920091:0:5830:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789127211.920123:0:5830:0:(import.c:65:import_set_state_nolock()) ffff8df790379800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789127211.920185:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeae6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876035752707328:12345-0@lo:38: Request processed in 171us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127211.920194:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1789127211.920235:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df79a3852c0 x1876035752707328/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789127221 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127211.920245:0:3299:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789127211.920251:0:3299:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1789127211.920257:0:3299:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789127211.920262:0:3299:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789127211.920272:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8df682adb800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789127211.920278:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a3852c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3299:1876035752707328:0@lo:38: 00000100:00100000:2.0:1789127211.923242:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789127211.923264:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a3852c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1876035752707712:0@lo:400: 00000100:00100000:2.0:1789127211.923341:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127211.923397:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752707712 00000100:00100000:2.0:1789127211.923404:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752707712 00000100:00100000:2.0:1789127211.923459:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789127211.923469:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79a3861c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1876035752707712:12345-0@lo:400: 00000100:00100000:2.0:1789127211.923527:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79a3861c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1876035752707712:12345-0@lo:400: Request processed in 58us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127211.923535:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789127211.923594:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df79a3852c0 x1876035752707712/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127227 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127211.923617:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a3852c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1876035752707712:0@lo:400: 00000100:00100000:0.0:1789127211.924024:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a386580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876035752707456:0@lo:400: 00000100:00100000:0.0:1789127211.924063:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127211.924102:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789127211.924109:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a384000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1876035752707584:0@lo:400: 00000100:00100000:0.0:1789127211.924136:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127211.924166:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752707456 00000100:00100000:0.0:1789127211.924170:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752707456 00000100:00100000:0.0:1789127211.924202:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752707584 00000100:00100000:0.0:1789127211.924206:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752707584 00000100:00100000:0.0:1789127211.924224:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789127211.924231:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeae43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876035752707456:12345-0@lo:400: 00000100:00100000:0.0:1789127211.924271:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeae43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876035752707456:12345-0@lo:400: Request processed in 40us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127211.924278:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789127211.924291:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789127211.924297:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeae4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876035752707584:12345-0@lo:400: 00000100:00100000:0.0:1789127211.924335:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeae4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876035752707584:12345-0@lo:400: Request processed in 38us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127211.924341:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1789127211.924372:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df79a384000 x1876035752707584/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127227 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127211.924384:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a384000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1876035752707584:0@lo:400: 00010000:00080000:0.0:1789127211.924395:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df79a386580 x1876035752707456/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127227 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127211.924418:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a386580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876035752707456:0@lo:400: 00000040:00080000:0.0:1789127211.924862:0:7642:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:1.0:1789127211.926415:0:7628:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1789127211.926460:0:7628:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789127211.926478:0:7628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df780031600/0xeeacf7c024300300 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c024300307 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127211.926490:0:7628:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff8df780031600/0xeeacf7c024300300 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c024300307 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789127211.926541:0:7628:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789127211.926543:0:7628:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789127211.926544:0:7628:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789127211.926545:0:7628:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789127211.926546:0:7628:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789127211.926547:0:7628:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789127211.926549:0:7628:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000100:00100000:2.0:1789127211.926882:0:7644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a3852c0 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7644:1876035752707840:0@lo:901: 00000100:00100000:2.0:1789127211.926964:0:7644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127211.927022:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752707840 00000100:00100000:2.0:1789127211.927028:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752707840 00000100:00100000:2.0:1789127211.927716:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789127211.927727:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79a386580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7644:x1876035752707840:12345-0@lo:901: 00000100:00080000:0.0:1789127211.928017:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789127211.928225:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79a386580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7644:x1876035752707840:12345-0@lo:901: Request processed in 498us (1259us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127211.928233:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000020:01000004:1.0:1789127211.928244:0:7628:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789127211.928248:0:7628:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789127211.928250:0:7628:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789127211.928252:0:7628:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789127211.928257:0:7628:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:1.0:1789127211.928261:0:7628:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789127211.928262:0:7628:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789127211.928264:0:7628:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789127211.928265:0:7628:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789127211.928267:0:7628:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789127211.928268:0:7628:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789127211.928270:0:7628:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789127211.928272:0:7628:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789127211.928273:0:7628:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789127211.928274:0:7628:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789127211.928275:0:7628:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1789127211.928283:0:7644:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df6825b80c0 going to sleep for 11 seconds 00010000:00080000:2.0:1789127211.928312:0:7644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df79a3852c0 x1876035752707840/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1789127227 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1789127211.928320:0:7628:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789127211.928326:0:7644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a3852c0 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7644:1876035752707840:0@lo:901: 00000100:00100000:1.0:1789127211.928344:0:7628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7bfc48b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:7628:1876035752707968:0@lo:253: 00000100:00100000:1.0:1789127211.928396:0:7628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127211.928477:0:7628:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df788128cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789127211.931691:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752707968 00000100:00100000:0.0:1789127211.931705:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752707968 00000100:00100000:1.0:1789127211.934342:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789127211.934356:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df788034850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+14:7628:x1876035752707968:12345-0@lo:253: 20000000:01000000:1.0:1789127211.934392:0:5822:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1789127211.934406:0:5822:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789127212.010151:0:5822:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789127212.010173:0:5822:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1789127212.011297:0:5846:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789127212.011305:0:5846:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789127212.011325:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8df7c2050200/0xeeacf7c024300323 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127212.011344:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df780030e00/0xeeacf7c024300274 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c02430026d expref: 14 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127212.011352:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8df7c2050200/0xeeacf7c024300323 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127212.011391:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df780030e00/0xeeacf7c024300274 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xeeacf7c02430026d expref: 14 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127212.011408:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df780030e00/0xeeacf7c024300274 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xeeacf7c02430026d expref: 14 pid: 5824 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127212.011422:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7bfc4ad00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5846:1876035752708096:0@lo:104: 00000100:00100000:1.0:1789127212.011485:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127212.011537:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df788128840 going to sleep for 11 seconds 00000100:00100000:1.0:1789127212.012603:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752708096 00000100:00100000:1.0:1789127212.012612:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752708096 00000100:00100000:1.0:1789127212.012664:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789127212.012674:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bfc4b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+3:5846:x1876035752708096:12345-0@lo:104: 00010000:00010000:1.0:1789127212.012702:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.140@tcp lock: ffff8df780031000/0xeeacf7c02430026d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xeeacf7c024300274 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127212.012781:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789127212.012802:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bfc4b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+3:5846:x1876035752708096:12345-0@lo:104: Request processed in 115us (1303us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127212.012810:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1789127212.012835:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789127212.012841:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.140@tcp lock: ffff8df780031000/0xeeacf7c02430026d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xeeacf7c024300274 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127212.012849:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df780031000 already unused, calling callback (ffffffffc1da1c20) 10000000:00010000:1.0:1789127212.012853:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.140@tcp lock: ffff8df780031000/0xeeacf7c02430026d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xeeacf7c024300274 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127212.012862:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: ffff8df780031000/0xeeacf7c02430026d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xeeacf7c024300274 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789127212.012869:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: ffff8df780031000/0xeeacf7c02430026d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xeeacf7c024300274 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789127212.012875:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789127212.012907:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.140@tcp lock: ffff8df780031000/0xeeacf7c02430026d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c024300274 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127212.012914:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789127212.012933:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.140@tcp lock: ffff8df780031000/0xeeacf7c02430026d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c024300274 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127212.012941:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: ffff8df780031000/0xeeacf7c02430026d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c024300274 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127212.012967:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127212.012969:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127212.012970:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127212.012987:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789127212.013000:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7bfc4bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3300:1876035752708224:0@lo:103: 00000100:00100000:1.0:1789127212.013039:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127212.013368:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7bfc4ad00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5846:1876035752708096:0@lo:104: 00010000:00010000:0.0:1789127212.013390:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8df7c2050200/0xeeacf7c024300323 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127212.013723:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752708224 00000100:00100000:3.0:1789127212.013729:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752708224 00010000:00010000:3.0:1789127212.013752:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df780030e00/0xeeacf7c024300274 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xeeacf7c02430026d expref: 15 pid: 5824 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127212.013783:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789127212.013815:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7889c8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+15:3300:x1876035752708224:12345-0@lo:103: 00010000:00010000:3.0:1789127212.013827:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127212.013832:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df780030e00/0xeeacf7c024300274 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xeeacf7c02430026d expref: 15 pid: 5824 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127212.013843:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df780030e00/0xeeacf7c024300274 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xeeacf7c02430026d expref: 15 pid: 5824 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127212.013859:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df780030e00/0xeeacf7c024300274 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xeeacf7c02430026d expref: 15 pid: 5824 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127212.013873:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8df7c2050200/0xeeacf7c024300323 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127212.013895:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df7c2050200/0xeeacf7c024300323 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789127212.013911:0:5815:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002606660s 00010000:00010000:3.0:1789127212.013915:0:5815:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df7c2050200/0xeeacf7c024300323 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127212.013921:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df7c2050200/0xeeacf7c024300323 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127212.013927:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8df7c2050200/0xeeacf7c024300323 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127212.013934:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8df7c2050200/0xeeacf7c024300323 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127212.013940:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7c2050200 already unused, calling callback (ffffffffc17a4550) 00010000:00010000:3.0:1789127212.013943:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8df7c2050200/0xeeacf7c024300323 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127212.013950:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8df7c2050200/0xeeacf7c024300323 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127212.013967:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8df7c2050200/0xeeacf7c024300323 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127212.013976:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127212.014021:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7889c8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+14:3300:x1876035752708224:12345-0@lo:103: Request processed in 207us (982us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127212.014028:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789127212.014090:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7bfc4bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3300:1876035752708224:0@lo:103: 00010000:00010000:1.0:1789127212.017382:0:5846:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8df7c2050200/0xeeacf7c024300323 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127212.017403:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8df7c2050200/0xeeacf7c024300323 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127212.017412:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df7c2050200/0xeeacf7c024300323 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127212.087183:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df788034850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+13:7628:x1876035752707968:12345-0@lo:253: Request processed in 152821us (158778us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127212.087199:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789127212.087319:0:7628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7bfc48b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:7628:1876035752707968:0@lo:253: 10000000:01000000:2.0:1789127212.087335:0:7628:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789127212.087339:0:7628:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789127212.087341:0:7628:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789127212.087342:0:7628:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789127212.087343:0:7628:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789127212.087344:0:7628:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789127212.087345:0:7628:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789127212.087347:0:7628:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789127212.087348:0:7628:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789127212.087350:0:7628:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789127212.087351:0:7628:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789127212.087366:0:7628:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789127212.087380:0:7628:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789127212.092730:0:7628:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1789127212.093076:0:7628:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1789127212.093304:0:7628:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1789127212.093471:0:7628:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1789127212.093943:0:7628:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x8:0x0] (8/8/4) registered 00080000:10000000:3.0:1789127212.094152:0:7628:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1789127212.095635:0:7628:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1789127212.289403:0:7628:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1789127212.289410:0:7628:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1789127212.289440:0:7628:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789127212.289491:0:7628:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.140@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789127212.289504:0:7628:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1789127212.289526:0:7628:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1789127212.468180:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127213.490945:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127214.516499:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127215.539046:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127216.564999:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127216.631230:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7aeae6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752708352:0@lo:13: 00000100:00100000:2.0:1789127216.631299:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127216.631436:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752708352 00000100:00100000:1.0:1789127216.631444:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752708352 00000100:00100000:1.0:1789127216.631506:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789127216.631540:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79a384000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876035752708352:12345-0@lo:13: 00002000:00000024:1.0:1789127216.631584:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1789127216.631658:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789127216.638724:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79a384000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876035752708352:12345-0@lo:13: Request processed in 7187us (7415us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127216.638738:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1789127216.639669:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df7aeae6580 x1876035752708352/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127232 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127216.639694:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7aeae6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752708352:0@lo:13: 00000100:00100000:0.0:1789127217.142127:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7bfc492c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3303:1876035752708480:0@lo:400: 00000100:00100000:0.0:1789127217.142193:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127217.142349:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752708480 00000100:00100000:3.0:1789127217.142357:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752708480 00000100:00100000:3.0:1789127217.142403:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789127217.142413:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df788037050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+13:3303:x1876035752708480:12345-0@lo:400: 00000100:00100000:2.0:1789127217.142724:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7bfc4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752708864:0@lo:400: 00000100:00100000:2.0:1789127217.142756:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127217.142806:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7bfc49a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1876035752708736:0@lo:400: 00000100:00100000:2.0:1789127217.142832:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127217.142851:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789127217.142857:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7bfc49e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876035752708608:0@lo:400: 00000100:00100000:2.0:1789127217.142893:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127217.142917:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752708864 00000100:00100000:2.0:1789127217.142921:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752708864 00000100:00100000:2.0:1789127217.142947:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789127217.142953:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79a3852c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1876035752708864:12345-0@lo:400: 00000100:00100000:2.0:1789127217.142986:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79a3852c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1876035752708864:12345-0@lo:400: Request processed in 33us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127217.142993:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789127217.143011:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752708736 00000100:00100000:2.0:1789127217.143020:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752708736 00000100:00100000:2.0:1789127217.143047:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752708608 00000100:00100000:2.0:1789127217.143050:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752708608 00000100:00100000:2.0:1789127217.143060:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789127217.143065:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df798d96940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876035752708736:12345-0@lo:400: 00000100:00100000:2.0:1789127217.143094:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df798d96940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876035752708736:12345-0@lo:400: Request processed in 28us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127217.143099:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789127217.143108:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789127217.143113:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df682c721c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876035752708608:12345-0@lo:400: 00000100:00100000:2.0:1789127217.143132:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df682c721c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876035752708608:12345-0@lo:400: Request processed in 19us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127217.143137:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1789127217.143168:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df7bfc4b480 x1876035752708864/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127233 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127217.143180:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7bfc4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752708864:0@lo:400: 00000100:00080000:2.0:1789127217.143197:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789127217.143209:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df7bfc49e00 x1876035752708608/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127233 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127217.143218:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7bfc49e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876035752708608:0@lo:400: 00010000:00080000:2.0:1789127217.143226:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df7bfc49a40 x1876035752708736/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127233 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127217.143234:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7bfc49a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1876035752708736:0@lo:400: 00000100:00100000:3.0:1789127217.143827:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df788037050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+13:3303:x1876035752708480:12345-0@lo:400: Request processed in 1413us (1631us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127217.143835:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789127217.143915:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7bfc492c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3303:1876035752708480:0@lo:400: 00000100:00100000:0.0:1789127217.146068:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7bfc4a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1876035752708992:0@lo:400: 00000100:00100000:0.0:1789127217.146129:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127217.150815:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752708992 00000100:00100000:3.0:1789127217.150829:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752708992 00000100:00100000:3.0:1789127217.150900:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789127217.150916:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeae7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876035752708992:12345-0@lo:400: 00000100:00100000:3.0:1789127217.151006:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeae7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876035752708992:12345-0@lo:400: Request processed in 92us (4876us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127217.151013:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1789127217.151061:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df7bfc4a1c0 x1876035752708992/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127233 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127217.151076:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7bfc4a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1876035752708992:0@lo:400: 00000100:00080000:0.0:1789127217.151150:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789127217.587902:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127218.611187:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789127219.422561:0:7985:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789127219.638029:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127220.659199:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789127220.728750:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789127220.728758:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8df788896800 from 30 10000000:01000000:2.0:1789127220.728770:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789127220.728826:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df7c2173600/0xeeacf7c02430032a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127220.728837:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff8df7c2173600/0xeeacf7c02430032a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127220.728848:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff8df7c2173600/0xeeacf7c02430032a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127220.728872:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df682c71e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752709120:0@lo:101: 00000100:00100000:2.0:1789127220.728938:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127220.728995:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df6825b8b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789127220.729633:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752709120 00000100:00100000:3.0:1789127220.729647:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752709120 00000100:00100000:3.0:1789127220.729703:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789127220.729712:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7906c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+13:5827:x1876035752709120:12345-0@lo:101: 00010000:00010000:3.0:1789127220.729725:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127220.729738:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df798df1e00/0xeeacf7c024300331 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xeeacf7c02430032a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127220.729763:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df798df1e00/0xeeacf7c024300331 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xeeacf7c02430032a expref: 14 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127220.729774:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df798df1e00/0xeeacf7c024300331 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c02430032a expref: 14 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127220.729783:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df798df1e00, rc 0) 00000100:00100000:3.0:1789127220.729855:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7906c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+14:5827:x1876035752709120:12345-0@lo:101: Request processed in 143us (916us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127220.729861:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789127220.729987:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df682c71e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752709120:0@lo:101: 00010000:00010000:2.0:1789127220.730002:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff8df7c2173600/0xeeacf7c02430032a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c024300331 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127220.730011:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff8df7c2173600/0xeeacf7c02430032a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xeeacf7c024300331 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127220.730068:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df682c71e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752709248:0@lo:501: 00000100:00100000:2.0:1789127220.730094:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127220.730115:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df6825b8b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789127220.730160:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752709248 00000100:00100000:3.0:1789127220.730164:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752709248 00000100:00100000:3.0:1789127220.730194:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789127220.730200:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7906c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+14:5827:x1876035752709248:12345-0@lo:501: 00000100:00100000:3.0:1789127220.730491:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7906c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+14:5827:x1876035752709248:12345-0@lo:501: Request processed in 290us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127220.730499:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789127220.730643:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df682c71e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752709248:0@lo:501: 00000100:00100000:2.0:1789127220.730673:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df682c71e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752709376:0@lo:503: 00000100:00100000:2.0:1789127220.730710:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127220.730734:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df6825b8b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789127220.730777:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752709376 00000100:00100000:3.0:1789127220.730781:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752709376 00000100:00100000:3.0:1789127220.730831:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789127220.730837:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7906c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+14:5827:x1876035752709376:12345-0@lo:503: 00000100:00100000:3.0:1789127220.731098:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7906c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+14:5827:x1876035752709376:12345-0@lo:503: Request processed in 260us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127220.731111:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789127220.731196:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df682c71e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752709376:0@lo:503: 00000100:00100000:2.0:1789127220.731865:0:8057:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df682c71e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:8057:1876035752709504:0@lo:502: 00000100:00100000:2.0:1789127220.731908:0:8057:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127220.731937:0:8057:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df6825b86c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789127220.732268:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752709504 00000100:00100000:3.0:1789127220.732274:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752709504 00000100:00100000:3.0:1789127220.732305:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789127220.732311:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7906c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+14:8057:x1876035752709504:12345-0@lo:502: 00000100:00100000:3.0:1789127220.734022:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7906c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+14:8057:x1876035752709504:12345-0@lo:502: Request processed in 1705us (2107us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127220.734035:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789127220.734257:0:8057:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df682c71e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:8057:1876035752709504:0@lo:502: 00000100:00100000:2.0:1789127220.734329:0:8057:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df682c71e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:8057:1876035752709632:0@lo:502: 00000100:00100000:2.0:1789127220.734373:0:8057:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127220.734413:0:8057:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df6825b86c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789127220.737971:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752709632 00000100:00100000:0.0:1789127220.737985:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752709632 00000100:00100000:0.0:1789127220.738033:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789127220.738042:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7906cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+14:8057:x1876035752709632:12345-0@lo:502: 00000100:00100000:0.0:1789127220.738308:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7906cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+14:8057:x1876035752709632:12345-0@lo:502: Request processed in 266us (3934us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127220.738316:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789127220.738430:0:8057:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df682c71e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:8057:1876035752709632:0@lo:502: 00000040:00080000:2.0:1789127220.738466:0:8057:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1789127220.739260:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1789127220.739280:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789127220.739295:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df7c2173600/0xeeacf7c02430032a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c024300331 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127220.739306:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff8df7c2173600/0xeeacf7c02430032a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c024300331 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127220.739314:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1789127220.739317:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1789127220.739319:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789127220.739349:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df780030e00/0xeeacf7c024300338 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127220.739357:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff8df780030e00/0xeeacf7c024300338 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127220.739365:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff8df780030e00/0xeeacf7c024300338 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127220.739387:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7aeae4b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752709760:0@lo:101: 00000100:00100000:0.0:1789127220.739432:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127220.739467:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df788830c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789127220.739870:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752709760 00000100:00100000:3.0:1789127220.739875:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752709760 00000100:00100000:3.0:1789127220.739916:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789127220.739923:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7906ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+14:5827:x1876035752709760:12345-0@lo:101: 00010000:00010000:3.0:1789127220.739933:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127220.739944:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df798df0e00/0xeeacf7c02430033f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xeeacf7c024300338 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127220.739963:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df798df0e00/0xeeacf7c02430033f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xeeacf7c024300338 expref: 15 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127220.739972:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df798df0e00/0xeeacf7c02430033f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c024300338 expref: 15 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127220.739980:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df798df0e00, rc 0) 00000100:00100000:3.0:1789127220.740020:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7906ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+15:5827:x1876035752709760:12345-0@lo:101: Request processed in 98us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127220.740026:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789127220.740780:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7aeae4b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752709760:0@lo:101: 00010000:00010000:1.0:1789127220.740866:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff8df780030e00/0xeeacf7c024300338 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c02430033f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127220.740877:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff8df780030e00/0xeeacf7c024300338 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xeeacf7c02430033f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127220.740938:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7bfc48f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752709888:0@lo:501: 00000100:00100000:1.0:1789127220.740974:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127220.741048:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df784d5d840 going to sleep for 11 seconds 00000100:00100000:3.0:1789127220.741151:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752709888 00000100:00100000:3.0:1789127220.741157:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752709888 00000100:00100000:3.0:1789127220.741206:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789127220.741214:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7906c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+15:5827:x1876035752709888:12345-0@lo:501: 00000100:00100000:3.0:1789127220.741453:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7906c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+15:5827:x1876035752709888:12345-0@lo:501: Request processed in 239us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127220.741459:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789127220.741551:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7bfc48f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752709888:0@lo:501: 00000100:00100000:1.0:1789127220.741579:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7bfc48f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752710016:0@lo:503: 00000100:00100000:1.0:1789127220.741618:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127220.741641:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df784d5d840 going to sleep for 11 seconds 00000100:00100000:0.0:1789127220.741752:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752710016 00000100:00100000:0.0:1789127220.741757:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752710016 00000100:00100000:0.0:1789127220.741815:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789127220.741823:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7906ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+15:5827:x1876035752710016:12345-0@lo:503: 00000100:00100000:0.0:1789127220.742091:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7906ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+15:5827:x1876035752710016:12345-0@lo:503: Request processed in 268us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127220.742098:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789127220.742288:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7bfc48f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752710016:0@lo:503: 00000100:00100000:2.0:1789127220.742842:0:8058:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df682c71e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:8058:1876035752710144:0@lo:502: 00000100:00100000:2.0:1789127220.742888:0:8058:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127220.742921:0:8058:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df6825b8000 going to sleep for 11 seconds 00000100:00100000:0.0:1789127220.743000:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752710144 00000100:00100000:0.0:1789127220.743004:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752710144 00000100:00100000:0.0:1789127220.743042:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789127220.743050:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7906c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+15:8058:x1876035752710144:12345-0@lo:502: 00000100:00100000:0.0:1789127220.743249:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7906c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+15:8058:x1876035752710144:12345-0@lo:502: Request processed in 198us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127220.743256:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789127220.743329:0:8058:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df682c71e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:8058:1876035752710144:0@lo:502: 00000020:01000000:2.0:1789127220.743356:0:8058:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789127220.743365:0:8058:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127220.743367:0:8058:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789127220.743371:0:8058:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789127220.743373:0:8058:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789127220.743389:0:8058:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df682c71e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:8058:1876035752710272:0@lo:502: 00000100:00100000:2.0:1789127220.743420:0:8058:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127220.743445:0:8058:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df6825b8000 going to sleep for 11 seconds 00000100:00100000:3.0:1789127220.743508:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752710272 00000100:00100000:3.0:1789127220.743512:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752710272 00000100:00100000:3.0:1789127220.743564:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789127220.743571:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7906cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+15:8058:x1876035752710272:12345-0@lo:502: 00000100:00100000:3.0:1789127220.743713:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7906cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+15:8058:x1876035752710272:12345-0@lo:502: Request processed in 142us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127220.743720:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789127220.743939:0:8058:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df682c71e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:8058:1876035752710272:0@lo:502: 00000020:01000000:1.0:1789127220.743960:0:8058:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789127220.743965:0:8058:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127220.743967:0:8058:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789127220.743970:0:8058:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:3.0:1789127220.744129:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:3.0:1789127220.744147:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789127220.744154:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df780030e00/0xeeacf7c024300338 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c02430033f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127220.744165:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff8df780030e00/0xeeacf7c024300338 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c02430033f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127220.744174:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789127220.744176:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8df788820800 from 30 10000000:01000000:3.0:1789127220.744179:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789127220.744200:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df798df1200/0xeeacf7c024300346 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127220.744208:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff8df798df1200/0xeeacf7c024300346 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127220.744227:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff8df798df1200/0xeeacf7c024300346 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127220.744239:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a2c61c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752710400:0@lo:101: 00000100:00100000:3.0:1789127220.744265:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127220.744319:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df782d71840 going to sleep for 11 seconds 00000100:00100000:2.0:1789127220.744431:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752710400 00000100:00100000:2.0:1789127220.744436:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752710400 00000100:00100000:2.0:1789127220.744470:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789127220.744477:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7906ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+15:5827:x1876035752710400:12345-0@lo:101: 00010000:00010000:2.0:1789127220.744486:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127220.744503:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df7c2172c00/0xeeacf7c02430034d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xeeacf7c024300346 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127220.744548:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df7c2172c00/0xeeacf7c02430034d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xeeacf7c024300346 expref: 16 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127220.744559:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df7c2172c00/0xeeacf7c02430034d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c024300346 expref: 16 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127220.744567:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7c2172c00, rc 0) 00000100:00100000:2.0:1789127220.744640:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7906ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+16:5827:x1876035752710400:12345-0@lo:101: Request processed in 162us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127220.744646:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789127220.745002:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a2c61c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752710400:0@lo:101: 00010000:00010000:1.0:1789127220.745021:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff8df798df1200/0xeeacf7c024300346 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c02430034d expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127220.745029:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff8df798df1200/0xeeacf7c024300346 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xeeacf7c02430034d expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127220.745080:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7bfc48f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752710528:0@lo:501: 00000100:00100000:1.0:1789127220.745109:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127220.745138:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df784d5d840 going to sleep for 11 seconds 00000100:00100000:2.0:1789127220.745172:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752710528 00000100:00100000:2.0:1789127220.745176:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752710528 00000100:00100000:2.0:1789127220.745232:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789127220.745238:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7906cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+16:5827:x1876035752710528:12345-0@lo:501: 00000100:00100000:2.0:1789127220.745440:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7906cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+16:5827:x1876035752710528:12345-0@lo:501: Request processed in 201us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127220.745453:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789127220.745506:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7bfc48f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752710528:0@lo:501: 00000100:00100000:1.0:1789127220.745552:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7bfc48f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752710656:0@lo:503: 00000100:00100000:1.0:1789127220.745587:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127220.745728:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df784d5d840 going to sleep for 11 seconds 00000100:00100000:3.0:1789127220.745879:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752710656 00000100:00100000:3.0:1789127220.745884:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752710656 00000100:00100000:3.0:1789127220.745905:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789127220.745911:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7906c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+16:5827:x1876035752710656:12345-0@lo:503: 00000100:00100000:3.0:1789127220.746058:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7906c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+16:5827:x1876035752710656:12345-0@lo:503: Request processed in 146us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127220.746064:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789127220.746127:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7bfc48f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752710656:0@lo:503: 00000100:00100000:0.0:1789127220.746507:0:8059:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7aeae6d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:8059:1876035752710784:0@lo:502: 00000100:00100000:0.0:1789127220.746558:0:8059:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127220.746586:0:8059:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df788128300 going to sleep for 11 seconds 00000100:00100000:3.0:1789127220.746635:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752710784 00000100:00100000:3.0:1789127220.746639:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752710784 00000100:00100000:3.0:1789127220.746705:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789127220.746712:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7906cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+16:8059:x1876035752710784:12345-0@lo:502: 00000100:00100000:3.0:1789127220.747043:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7906cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+16:8059:x1876035752710784:12345-0@lo:502: Request processed in 330us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127220.747051:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789127220.747107:0:8059:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7aeae6d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:8059:1876035752710784:0@lo:502: 00000100:00100000:0.0:1789127220.747149:0:8059:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7aeae6d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:8059:1876035752710912:0@lo:502: 00000100:00100000:0.0:1789127220.747180:0:8059:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127220.747237:0:8059:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df788128300 going to sleep for 11 seconds 00000100:00100000:2.0:1789127220.747268:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752710912 00000100:00100000:2.0:1789127220.747273:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752710912 00000100:00100000:2.0:1789127220.747302:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789127220.747309:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7906c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+16:8059:x1876035752710912:12345-0@lo:502: 00000100:00100000:2.0:1789127220.747472:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7906c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+16:8059:x1876035752710912:12345-0@lo:502: Request processed in 164us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127220.747479:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789127220.747576:0:8059:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7aeae6d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:8059:1876035752710912:0@lo:502: 00000040:00080000:0.0:1789127220.747596:0:8059:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1789127220.747744:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1789127220.747765:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789127220.747774:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df798df1200/0xeeacf7c024300346 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c02430034d expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127220.747784:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff8df798df1200/0xeeacf7c024300346 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c02430034d expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789127220.747954:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789127220.747957:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8df788820800 from 5 10000000:01000000:1.0:1789127220.747960:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789127220.747985:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df7c2051c00/0xeeacf7c024300354 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127220.748002:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff8df7c2051c00/0xeeacf7c024300354 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127220.748011:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff8df7c2051c00/0xeeacf7c024300354 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127220.748023:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7bfc48f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752711040:0@lo:101: 00000100:00100000:1.0:1789127220.748052:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127220.748118:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df784d5d840 going to sleep for 11 seconds 00000100:00100000:3.0:1789127220.748145:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752711040 00000100:00100000:3.0:1789127220.748149:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752711040 00000100:00100000:3.0:1789127220.748206:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789127220.748213:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7906cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+16:5827:x1876035752711040:12345-0@lo:101: 00010000:00010000:3.0:1789127220.748221:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127220.748232:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df798df0600/0xeeacf7c02430035b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xeeacf7c024300354 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127220.748258:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df798df0600/0xeeacf7c02430035b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xeeacf7c024300354 expref: 17 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127220.748268:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df798df0600/0xeeacf7c02430035b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c024300354 expref: 17 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127220.748276:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df798df0600, rc 0) 00000100:00100000:3.0:1789127220.748314:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7906cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+17:5827:x1876035752711040:12345-0@lo:101: Request processed in 102us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127220.748320:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789127220.748373:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7bfc48f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752711040:0@lo:101: 00010000:00010000:1.0:1789127220.748384:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff8df7c2051c00/0xeeacf7c024300354 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c02430035b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127220.748392:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff8df7c2051c00/0xeeacf7c024300354 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xeeacf7c02430035b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127220.748432:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7bfc48f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752711168:0@lo:256: 00000100:00100000:1.0:1789127220.748459:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127220.748559:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df784d5d840 going to sleep for 11 seconds 00000100:00100000:2.0:1789127220.748639:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752711168 00000100:00100000:2.0:1789127220.748644:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752711168 00000100:00100000:2.0:1789127220.748668:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789127220.748674:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7880ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+17:5827:x1876035752711168:12345-0@lo:256: 20000000:01000000:2.0:1789127220.748687:0:5822:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789127220.748702:0:5822:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789127220.748705:0:5822:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1789127220.748784:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7880ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+17:5827:x1876035752711168:12345-0@lo:256: Request processed in 110us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127220.748854:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789127220.748945:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7bfc48f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752711168:0@lo:256: 10000000:01000000:1.0:1789127220.748984:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789127220.748991:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df7c2051c00/0xeeacf7c024300354 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c02430035b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127220.748998:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff8df7c2051c00/0xeeacf7c024300354 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c02430035b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789127220.749015:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1789127220.749017:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:1.0:1789127220.749020:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789127220.749036:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df7c2051200/0xeeacf7c024300362 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127220.749043:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff8df7c2051200/0xeeacf7c024300362 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127220.749050:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff8df7c2051200/0xeeacf7c024300362 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127220.749062:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7bfc48f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752711296:0@lo:101: 00000100:00100000:1.0:1789127220.749090:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127220.749111:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df784d5d840 going to sleep for 11 seconds 00000100:00100000:1.0:1789127220.749123:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752711296 00000100:00100000:1.0:1789127220.749127:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752711296 00000100:00100000:1.0:1789127220.749145:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789127220.749150:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7880ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+17:5827:x1876035752711296:12345-0@lo:101: 00010000:00010000:1.0:1789127220.749157:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127220.749164:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df7c2051400/0xeeacf7c024300369 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xeeacf7c024300362 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127220.749180:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df7c2051400/0xeeacf7c024300369 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xeeacf7c024300362 expref: 18 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127220.749189:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df7c2051400/0xeeacf7c024300369 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c024300362 expref: 18 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127220.749207:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7c2051400, rc 0) 00000100:00100000:1.0:1789127220.749233:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7880ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+18:5827:x1876035752711296:12345-0@lo:101: Request processed in 82us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127220.749238:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789127220.749262:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7bfc48f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752711296:0@lo:101: 00010000:00010000:1.0:1789127220.749271:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff8df7c2051200/0xeeacf7c024300362 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c024300369 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127220.749278:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff8df7c2051200/0xeeacf7c024300362 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xeeacf7c024300369 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127220.749315:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7bfc48f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752711424:0@lo:501: 00000100:00100000:1.0:1789127220.749337:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127220.749348:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df784d5d840 going to sleep for 11 seconds 00000100:00100000:1.0:1789127220.749358:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752711424 00000100:00100000:1.0:1789127220.749361:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752711424 00000100:00100000:1.0:1789127220.749374:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789127220.749379:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7880ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+18:5827:x1876035752711424:12345-0@lo:501: 00000100:00100000:1.0:1789127220.749592:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7880ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+18:5827:x1876035752711424:12345-0@lo:501: Request processed in 211us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127220.749598:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789127220.749626:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7bfc48f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752711424:0@lo:501: 00000100:00100000:1.0:1789127220.749649:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7bfc48f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752711552:0@lo:503: 00000100:00100000:1.0:1789127220.749684:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127220.749697:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df784d5d840 going to sleep for 11 seconds 00000100:00100000:1.0:1789127220.749713:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752711552 00000100:00100000:1.0:1789127220.749716:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752711552 00000100:00100000:1.0:1789127220.749731:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789127220.749736:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7880ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+18:5827:x1876035752711552:12345-0@lo:503: 00000100:00100000:1.0:1789127220.750005:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7880ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+18:5827:x1876035752711552:12345-0@lo:503: Request processed in 268us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127220.750013:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789127220.750049:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7bfc48f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752711552:0@lo:503: 00000100:00100000:1.0:1789127220.750632:0:8060:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7bfc48f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:8060:1876035752711680:0@lo:502: 00000100:00100000:1.0:1789127220.750669:0:8060:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127220.750725:0:8060:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df784d5d780 going to sleep for 11 seconds 00000100:00100000:2.0:1789127220.750753:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752711680 00000100:00100000:2.0:1789127220.750758:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752711680 00000100:00100000:2.0:1789127220.750903:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789127220.750912:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7880aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+18:8060:x1876035752711680:12345-0@lo:502: 00000100:00100000:2.0:1789127220.751180:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7880aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+18:8060:x1876035752711680:12345-0@lo:502: Request processed in 269us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127220.751187:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789127220.751265:0:8060:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7bfc48f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:8060:1876035752711680:0@lo:502: 00000020:01000000:1.0:1789127220.751286:0:8060:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789127220.751293:0:8060:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1789127220.751300:0:8060:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127220.751302:0:8060:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1789127220.751307:0:8060:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789127220.751310:0:8060:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.140@tcp to nid 0x20000c0a8ce8c (192.168.206.140@tcp) 00000020:01000000:1.0:1789127220.751329:0:8060:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789127220.751331:0:8060:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789127220.751344:0:8060:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8df790d39a48) 00000020:00000080:1.0:1789127220.751363:0:8060:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1789127220.751367:0:8060:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789127220.751425:0:8060:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1789127220.751431:0:8060:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:1.0:1789127220.751436:0:8060:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xeeacf7c024300377 00010000:00080000:1.0:1789127220.751460:0:8060:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8df7ae060000@lustre-OST0001-osc-MDT0000: add connection 192.168.206.140@tcp at head 00010000:00010000:1.0:1789127220.751683:0:8060:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:1.0:1789127220.752000:0:8060:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1789127220.752010:0:8060:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1789127220.752432:0:8060:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789127220.752638:0:8060:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789127220.752689:0:8060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1789127220.752742:0:8060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1789127220.753343:0:8061:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789127220.753348:0:8061:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1789127220.753984:0:8060:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789127220.753995:0:8060:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789127220.754023:0:8060:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789127220.754041:0:8060:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xeeacf7c02430037e 00000100:00080000:1.0:1789127220.754050:0:8060:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789127220.754056:0:8060:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8df7ae060000 using connection 192.168.206.140@tcp/0@lo 00000100:00100000:1.0:1789127220.754085:0:8060:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df7bfc48f00 x1876035752711808/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789127220.754135:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7bfc48f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1876035752711808:0@lo:8: 00000100:00100000:0.0:1789127220.754203:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127220.754271:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752711808 00000100:00100000:2.0:1789127220.754277:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752711808 00000100:00100000:2.0:1789127220.754311:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789127220.754318:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeae6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3299:x1876035752711808:12345-0@lo:8: 00010000:00080000:2.0:1789127220.754340:0:6689:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 166 last 0 00000020:00000080:2.0:1789127220.754362:0:6689:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xeeacf7c024300385 00002000:00100000:2.0:1789127220.754374:0:6689:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8df682ad8800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113987 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1789127220.754378:0:6689:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:2.0:1789127220.754382:0:6689:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1789127220.754473:0:6689:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789127220.754601:0:6689:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789127220.754622:0:6689:0:(import.c:65:import_set_state_nolock()) ffff8df682adc800 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1789127220.754725:0:8060:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1789127220.754778:0:8060:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789127220.754782:0:8060:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127220.754785:0:8060:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1789127220.754805:0:8060:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789127220.754809:0:8060:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127220.754811:0:8060:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789127220.754813:0:8060:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789127220.754815:0:8060:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1789127220.754835:0:8060:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7bfc48b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:8060:1876035752711936:0@lo:502: 00000100:00100000:1.0:1789127220.754872:0:8060:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127220.754897:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752711936 00000100:00100000:1.0:1789127220.754900:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752711936 00000100:00100000:1.0:1789127220.754922:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789127220.754928:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7880ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+18:8060:x1876035752711936:12345-0@lo:502: 00000100:00100000:1.0:1789127220.755100:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7880ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+18:8060:x1876035752711936:12345-0@lo:502: Request processed in 170us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127220.755112:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789127220.755144:0:8060:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df784d5d240 going to sleep for 11 seconds 00000100:00100000:1.0:1789127220.755160:0:8060:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7bfc48b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:8060:1876035752711936:0@lo:502: 00000020:01000000:1.0:1789127220.755180:0:8060:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789127220.755183:0:8060:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127220.755184:0:8060:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789127220.755188:0:8060:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:1.0:1789127220.755234:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:1.0:1789127220.755247:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789127220.755255:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df7c2051200/0xeeacf7c024300362 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c024300369 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127220.755266:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff8df7c2051200/0xeeacf7c024300362 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c024300369 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789127220.755274:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1789127220.755276:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8df790d38000 from 1 10000000:01000000:1.0:1789127220.755279:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789127220.755297:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df7c2051e00/0xeeacf7c02430038c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127220.755304:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff8df7c2051e00/0xeeacf7c02430038c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127220.755312:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff8df7c2051e00/0xeeacf7c02430038c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127220.755322:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7bfc48b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752712064:0@lo:101: 00000100:00100000:1.0:1789127220.755347:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127220.755369:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df784d5d240 going to sleep for 11 seconds 00000100:00100000:1.0:1789127220.755383:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752712064 00000100:00100000:1.0:1789127220.755386:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752712064 00000100:00100000:1.0:1789127220.755407:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789127220.755414:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7880adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+18:5827:x1876035752712064:12345-0@lo:101: 00010000:00010000:1.0:1789127220.755421:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127220.755433:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df7c2050a00/0xeeacf7c024300393 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xeeacf7c02430038c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127220.755452:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df7c2050a00/0xeeacf7c024300393 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xeeacf7c02430038c expref: 19 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127220.755461:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df7c2050a00/0xeeacf7c024300393 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c02430038c expref: 19 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127220.755470:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7c2050a00, rc 0) 00000100:00100000:1.0:1789127220.755500:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7880adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:5827:x1876035752712064:12345-0@lo:101: Request processed in 88us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127220.755506:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789127220.755543:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7bfc48b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752712064:0@lo:101: 00010000:00010000:1.0:1789127220.755555:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff8df7c2051e00/0xeeacf7c02430038c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c024300393 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127220.755563:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff8df7c2051e00/0xeeacf7c02430038c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xeeacf7c024300393 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127220.755601:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7bfc48b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752712192:0@lo:501: 00000100:00100000:1.0:1789127220.755622:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127220.755634:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df784d5d240 going to sleep for 11 seconds 00000100:00100000:1.0:1789127220.755649:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752712192 00000100:00100000:1.0:1789127220.755652:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752712192 00000100:00100000:1.0:1789127220.755667:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789127220.755671:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7880ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:5827:x1876035752712192:12345-0@lo:501: 00000100:00100000:1.0:1789127220.755861:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7880ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:5827:x1876035752712192:12345-0@lo:501: Request processed in 189us (237us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789127220.755868:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789127220.755892:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7bfc48b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752712192:0@lo:501: 10000000:01000000:1.0:1789127220.755908:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789127220.755913:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df7c2051e00/0xeeacf7c02430038c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c024300393 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127220.755920:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff8df7c2051e00/0xeeacf7c02430038c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c024300393 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127220.756097:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a2c52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1876035752712448:0@lo:400: 00000100:00100000:3.0:1789127220.756125:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127220.756146:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789127220.756150:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a2c5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876035752712320:0@lo:400: 00000100:00100000:3.0:1789127220.756166:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127220.756183:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a2c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752712576:0@lo:400: 00000100:00100000:3.0:1789127220.756202:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127220.756216:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789127220.756220:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a2c61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1876035752712704:0@lo:400: 00000100:00100000:3.0:1789127220.756243:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127220.756270:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752712448 00000100:00100000:3.0:1789127220.756273:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752712448 00000100:00100000:3.0:1789127220.756297:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752712320 00000100:00100000:3.0:1789127220.756299:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752712320 00000100:00100000:3.0:1789127220.756308:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752712704 00000100:00100000:3.0:1789127220.756310:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752712704 00000100:00100000:3.0:1789127220.756321:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789127220.756332:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79a2c6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876035752712448:12345-0@lo:400: 00000100:00100000:3.0:1789127220.756364:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79a2c6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876035752712448:12345-0@lo:400: Request processed in 33us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127220.756370:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789127220.756381:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789127220.756385:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79a2c43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876035752712320:12345-0@lo:400: 00000100:00100000:3.0:1789127220.756404:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79a2c43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876035752712320:12345-0@lo:400: Request processed in 19us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127220.756409:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789127220.756416:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789127220.756421:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79206d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876035752712704:12345-0@lo:400: 00000100:00100000:3.0:1789127220.756443:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79206d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876035752712704:12345-0@lo:400: Request processed in 22us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127220.756449:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789127220.756474:0:6688:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1789127220.756479:0:6688:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00080000:3.0:1789127220.756494:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789127220.756511:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df79a2c61c0 x1876035752712704/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127236 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127220.756522:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a2c61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1876035752712704:0@lo:400: 00010000:00080000:3.0:1789127220.756556:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df79a2c5e00 x1876035752712320/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127236 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127220.756564:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a2c5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876035752712320:0@lo:400: 00010000:00080000:3.0:1789127220.756572:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df79a2c52c0 x1876035752712448/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127236 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127220.756589:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a2c52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1876035752712448:0@lo:400: 00000100:00100000:3.0:1789127220.756717:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752712576 00000100:00100000:3.0:1789127220.756721:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752712576 00000100:00100000:3.0:1789127220.756749:0:6688:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1789127220.756757:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789127220.756762:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79a2c4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1876035752712576:12345-0@lo:400: 00000100:00100000:3.0:1789127220.756834:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79a2c4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1876035752712576:12345-0@lo:400: Request processed in 71us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127220.756840:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1789127220.756853:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789127220.756882:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df79a2c7480 x1876035752712576/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127236 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127220.756892:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a2c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752712576:0@lo:400: 00000100:00100000:2.0:1789127220.757234:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeae6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3299:x1876035752711808:12345-0@lo:8: Request processed in 2913us (3028us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127220.757242:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1789127220.757296:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df7bfc48f00 x1876035752711808/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789127230 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127220.757305:0:3299:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789127220.757313:0:3299:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1789127220.757320:0:3299:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789127220.757325:0:3299:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1789127220.757328:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8df7ae060000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789127220.757380:0:3299:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789127220.757386:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7bfc48f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1876035752711808:0@lo:8: 00000004:00080000:3.0:1789127220.760271:0:8061:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789127220.760552:0:8061:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 166916762335ns, next at 0ns, rc = 0 00000004:00080000:2.0:1789127220.800024:0:8062:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:2.0:1789127220.800055:0:8062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df682c70000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8062:1876035752712960:0@lo:7: 00000100:00100000:2.0:1789127220.800121:0:8062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127220.800151:0:8062:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df6825b89c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789127220.800233:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df682c71a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1876035752712832:0@lo:13: 00000100:00100000:2.0:1789127220.800262:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127220.800302:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752712960 00000100:00100000:2.0:1789127220.800309:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752712960 00000100:00100000:2.0:1789127220.800362:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789127220.800371:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df682c703c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8062:x1876035752712960:12345-0@lo:7: 00000100:00080000:0.0:1789127220.802933:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789127220.802953:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752712832 00000100:00100000:0.0:1789127220.802962:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752712832 00000100:00100000:0.0:1789127220.803011:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789127220.803020:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df682c72940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3300:x1876035752712832:12345-0@lo:13: 00002000:00000024:0.0:1789127220.803054:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1789127220.803138:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df682c72940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3300:x1876035752712832:12345-0@lo:13: Request processed in 119us (2875us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127220.803146:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1789127220.809963:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df682c71a40 x1876035752712832/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127236 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127220.809991:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df682c71a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1876035752712832:0@lo:13: 00002000:00080000:2.0:1789127220.811971:0:6688:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1789127220.811978:0:6688:0:(ofd_dev.c:1222:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:2.0:1789127220.812064:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df682c703c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8062:x1876035752712960:12345-0@lo:7: Request processed in 11691us (11940us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127220.812075:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1789127220.812125:0:8062:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df682c70000 x1876035752712960/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789127236 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127220.812139:0:8062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df682c70000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8062:1876035752712960:0@lo:7: 00000004:00080000:2.0:1789127220.812152:0:8062:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:2.0:1789127220.812191:0:8062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df682c70000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8062:1876035752713088:0@lo:5: 00000100:00100000:2.0:1789127220.812227:0:8062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127220.812262:0:8062:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df6825b89c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789127220.812277:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752713088 00000100:00100000:2.0:1789127220.812282:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752713088 00000100:00100000:2.0:1789127220.812330:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789127220.812339:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df682c71a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8062:x1876035752713088:12345-0@lo:5: 00002000:00080000:2.0:1789127220.812363:0:6688:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1789127220.812367:0:6688:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1789127220.813030:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df682c71a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:8062:x1876035752713088:12345-0@lo:5: Request processed in 691us (801us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1789127220.813038:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1789127220.813070:0:8062:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df682c70000 x1876035752713088/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789127236 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127220.813082:0:8062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df682c70000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8062:1876035752713088:0@lo:5: 00000004:00080000:2.0:1789127220.813092:0:8062:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:2.0:1789127220.813119:0:8062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df682c71680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8062:1876035752713216:0@lo:700: 00000100:00100000:2.0:1789127220.813151:0:8062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127220.813180:0:8062:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df6825b89c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789127220.813610:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752713216 00000100:00100000:0.0:1789127220.813617:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752713216 00000100:00100000:0.0:1789127220.813664:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789127220.813672:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df682c70780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8062:x1876035752713216:12345-0@lo:700: 00000100:00100000:0.0:1789127220.813705:0:6695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7aeae70c0 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6695:1876035752713344:0@lo:700: 00000100:00100000:0.0:1789127220.813737:0:6695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127220.813757:0:6695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df787b71d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789127220.813771:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752713344 00000100:00100000:0.0:1789127220.813774:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752713344 00000100:00100000:0.0:1789127220.813823:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789127220.813830:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeae7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6695:x1876035752713344:12345-0@lo:700: 00000004:00080000:3.0:1789127220.838668:0:5852:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 40000000:02000000:2.0:1789127220.896371:0:5837:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:2.0:1789127220.903431:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeae7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6695:x1876035752713344:12345-0@lo:700: Request processed in 89595us (89686us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127220.903447:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789127220.903663:0:6695:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df7aeae70c0 x1876035752713344/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789127236 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127220.903677:0:6695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7aeae70c0 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6695:1876035752713344:0@lo:700: 40000000:02000000:3.0:1789127220.903690:0:6695:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000100:00100000:0.0:1789127220.973416:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df682c70780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8062:x1876035752713216:12345-0@lo:700: Request processed in 159736us (160255us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127220.973433:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000001:00080000:0.0:1789127220.973472:0:7646:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:0.0:1789127220.973498:0:7646:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:2.0:1789127220.974290:0:8062:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df682c71680 x1876035752713216/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789127236 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127220.974308:0:8062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df682c71680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8062:1876035752713216:0@lo:700: 00000004:02000040:0.0:1789127221.006879:0:8062:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:0.0:1789127221.017690:0:8062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7aeae4f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8062:1876035752713472:0@lo:5: 00000100:00100000:0.0:1789127221.017751:0:8062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127221.017803:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752713472 00000100:00100000:0.0:1789127221.017810:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752713472 00000100:00100000:0.0:1789127221.017856:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789127221.017866:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeae7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8062:x1876035752713472:12345-0@lo:5: 00000100:00100000:1.0:1789127221.019727:0:8062:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7833fa300 going to sleep for 11 seconds 00002000:00080000:0.0:1789127221.023305:0:6686:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1789127221.023325:0:6686:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:0.0:1789127221.026864:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeae7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8062:x1876035752713472:12345-0@lo:5: Request processed in 8993us (9105us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1789127221.026877:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1789127221.026992:0:8062:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df7aeae4f00 x1876035752713472/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789127237 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127221.027006:0:8062:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1789127221.027021:0:8062:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8df7aeae4f00 x1876035752713472/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789127237 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127221.027032:0:8062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7aeae4f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8062:1876035752713472:0@lo:5: 00000004:00080000:1.0:1789127221.027045:0:8062:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:2.0:1789127221.682942:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127221.747249:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7aeae70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1876035752713600:0@lo:13: 00000100:00100000:2.0:1789127221.747317:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127221.747542:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752713600 00000100:00100000:0.0:1789127221.747551:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752713600 00000100:00100000:0.0:1789127221.747600:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789127221.747615:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df682c72580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876035752713600:12345-0@lo:13: 00002000:00000024:0.0:1789127221.747647:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789127221.747690:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df682c72580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876035752713600:12345-0@lo:13: Request processed in 76us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127221.747697:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1789127221.747734:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df7aeae70c0 x1876035752713600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127237 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127221.747751:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7aeae70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1876035752713600:0@lo:13: 00010000:00010000:3.0:1789127222.707348:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127223.734969:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789127224.005628:0:7646:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:2.0:1789127224.555089:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127224.555309:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733815424 00000100:00100000:3.0:1789127224.555321:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733815424 00000100:00100000:3.0:1789127224.555370:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 113 00000100:00100000:3.0:1789127224.555378:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7880acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2345:x1876035733815424:12345-192.168.206.40@tcp:250: 00010000:00080000:3.0:1789127224.555417:0:5822:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from d829a69b-d740-4e4c-8301-ef09c9d45165@192.168.206.40@tcp t0 exp 0000000000000000 cur 170 last 0 00000020:00000080:3.0:1789127224.555445:0:5822:0:(genops.c:1385:class_connect()) connect: client d829a69b-d740-4e4c-8301-ef09c9d45165, cookie 0xeeacf7c02430039a 00000100:00080000:3.0:1789127224.555980:0:5822:0:(import.c:65:import_set_state_nolock()) ffff8df7a0326800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789127224.556750:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7880acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d829a69b-d740-4e4c-8301-ef09c9d45165+5:2345:x1876035733815424:12345-192.168.206.40@tcp:250: Request processed in 1368us (1666us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127224.556761:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 113 00000100:00100000:2.0:1789127224.571532:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127224.571674:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733815552 00000100:00100000:0.0:1789127224.571684:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733815552 00000100:00100000:0.0:1789127224.571742:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 114 00000100:00100000:0.0:1789127224.571753:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7880afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d829a69b-d740-4e4c-8301-ef09c9d45165+5:5576:x1876035733815552:12345-192.168.206.40@tcp:101: 00010000:00010000:0.0:1789127224.571783:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127224.571830:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df780030800/0xeeacf7c0243003a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b798a expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127224.571859:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df780030800/0xeeacf7c0243003a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b798a expref: 6 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127224.571871:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df780030800/0xeeacf7c0243003a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b798a expref: 6 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127224.571880:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df780030800, rc 0) 00000100:00100000:0.0:1789127224.571930:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7880afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d829a69b-d740-4e4c-8301-ef09c9d45165+6:5576:x1876035733815552:12345-192.168.206.40@tcp:101: Request processed in 179us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127224.571937:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 114 00000100:00100000:2.0:1789127224.573956:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127224.573992:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733815680 00000100:00100000:2.0:1789127224.574000:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733815680 00000100:00100000:2.0:1789127224.574048:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 115 00000100:00100000:2.0:1789127224.574057:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7880ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d829a69b-d740-4e4c-8301-ef09c9d45165+6:5576:x1876035733815680:12345-192.168.206.40@tcp:501: 00000100:00100000:2.0:1789127224.577849:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7880ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d829a69b-d740-4e4c-8301-ef09c9d45165+6:5576:x1876035733815680:12345-192.168.206.40@tcp:501: Request processed in 3780us (3889us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789127224.577865:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 115 00000100:00100000:1.0:1789127224.583722:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127224.583998:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733815808 00000100:00100000:3.0:1789127224.584007:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733815808 00000100:00100000:3.0:1789127224.584064:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 116 00000100:00100000:3.0:1789127224.584074:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7880af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d829a69b-d740-4e4c-8301-ef09c9d45165+6:5576:x1876035733815808:12345-192.168.206.40@tcp:101: 00010000:00010000:3.0:1789127224.584091:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127224.584109:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df798df0200/0xeeacf7c0243003a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7991 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127224.584135:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df798df0200/0xeeacf7c0243003a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7991 expref: 7 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127224.584146:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df798df0200/0xeeacf7c0243003a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7991 expref: 7 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127224.584154:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df798df0200, rc 0) 00000100:00100000:3.0:1789127224.584214:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7880af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d829a69b-d740-4e4c-8301-ef09c9d45165+7:5576:x1876035733815808:12345-192.168.206.40@tcp:101: Request processed in 142us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127224.584222:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 116 00000100:00100000:2.0:1789127224.588407:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127224.588490:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733815936 00000100:00100000:3.0:1789127224.588498:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733815936 00000100:00100000:3.0:1789127224.588562:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 117 00000100:00100000:3.0:1789127224.588575:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7880ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d829a69b-d740-4e4c-8301-ef09c9d45165+7:5576:x1876035733815936:12345-192.168.206.40@tcp:501: 00000100:00100000:3.0:1789127224.589041:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7880ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d829a69b-d740-4e4c-8301-ef09c9d45165+8:5576:x1876035733815936:12345-192.168.206.40@tcp:501: Request processed in 469us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127224.589051:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 117 00000100:00100000:0.0:1789127224.593209:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127224.593271:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733816064 00000100:00100000:2.0:1789127224.593281:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733816064 00000100:00100000:2.0:1789127224.593342:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 118 00000100:00100000:2.0:1789127224.593352:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7880af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d829a69b-d740-4e4c-8301-ef09c9d45165+8:5576:x1876035733816064:12345-192.168.206.40@tcp:503: 00000100:00100000:2.0:1789127224.594253:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7880af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d829a69b-d740-4e4c-8301-ef09c9d45165+8:5576:x1876035733816064:12345-192.168.206.40@tcp:503: Request processed in 898us (1121us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127224.594264:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 118 00000100:00100000:1.0:1789127224.599304:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127224.599379:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733816192 00000100:00100000:3.0:1789127224.599388:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733816192 00000100:00100000:3.0:1789127224.599440:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 119 00000100:00100000:3.0:1789127224.599450:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7880ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d829a69b-d740-4e4c-8301-ef09c9d45165+8:5595:x1876035733816192:12345-192.168.206.40@tcp:502: 00000100:00100000:3.0:1789127224.599837:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7880ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d829a69b-d740-4e4c-8301-ef09c9d45165+8:5595:x1876035733816192:12345-192.168.206.40@tcp:502: Request processed in 387us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127224.599846:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 119 00000100:00100000:2.0:1789127224.628444:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127224.628682:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733816320 00000100:00100000:3.0:1789127224.628692:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733816320 00000100:00100000:3.0:1789127224.628751:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 120 00000100:00100000:3.0:1789127224.628761:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7880af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d829a69b-d740-4e4c-8301-ef09c9d45165+8:5595:x1876035733816320:12345-192.168.206.40@tcp:502: 00000100:00100000:3.0:1789127224.629032:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7880af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d829a69b-d740-4e4c-8301-ef09c9d45165+8:5595:x1876035733816320:12345-192.168.206.40@tcp:502: Request processed in 271us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127224.629040:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 120 00000100:00100000:2.0:1789127224.635781:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127224.638772:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733816448 00000100:00100000:1.0:1789127224.638821:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733816448 00000100:00100000:1.0:1789127224.638878:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 121 00000100:00100000:1.0:1789127224.638887:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df786b43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d829a69b-d740-4e4c-8301-ef09c9d45165+8:5576:x1876035733816448:12345-192.168.206.40@tcp:101: 00010000:00010000:1.0:1789127224.638903:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127224.638918:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df7bbd96e00/0xeeacf7c0243003af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b79bb expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127224.638944:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df7bbd96e00/0xeeacf7c0243003af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b79bb expref: 9 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127224.638956:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df7bbd96e00/0xeeacf7c0243003af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b79bb expref: 9 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127224.638965:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7bbd96e00, rc 0) 00000100:00100000:1.0:1789127224.639021:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df786b43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d829a69b-d740-4e4c-8301-ef09c9d45165+9:5576:x1876035733816448:12345-192.168.206.40@tcp:101: Request processed in 135us (3247us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127224.639028:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 121 00000100:00100000:3.0:1789127224.648398:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127224.648473:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733816576 00000100:00100000:0.0:1789127224.648483:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733816576 00000100:00100000:0.0:1789127224.648554:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 122 00000100:00100000:0.0:1789127224.648564:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df786b40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d829a69b-d740-4e4c-8301-ef09c9d45165+9:5576:x1876035733816576:12345-192.168.206.40@tcp:256: 20000000:01000000:0.0:1789127224.648588:0:5822:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789127224.648610:0:5822:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789127224.648613:0:5822:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789127224.648616:0:5822:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789127224.648618:0:5822:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1789127224.657083:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df786b40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d829a69b-d740-4e4c-8301-ef09c9d45165+9:5576:x1876035733816576:12345-192.168.206.40@tcp:256: Request processed in 8510us (8684us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127224.657098:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 122 00000100:00100000:2.0:1789127224.662495:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127224.662821:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733816704 00000100:00100000:0.0:1789127224.662831:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733816704 00000100:00100000:0.0:1789127224.662878:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 123 00000100:00100000:0.0:1789127224.662887:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df786b43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d829a69b-d740-4e4c-8301-ef09c9d45165+9:5576:x1876035733816704:12345-192.168.206.40@tcp:101: 00010000:00010000:0.0:1789127224.662911:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127224.662930:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df780030600/0xeeacf7c0243003b6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b79c2 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127224.662956:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df780030600/0xeeacf7c0243003b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b79c2 expref: 10 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127224.662967:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df780030600/0xeeacf7c0243003b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b79c2 expref: 10 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127224.662976:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df780030600, rc 0) 00000100:00100000:0.0:1789127224.663030:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df786b43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d829a69b-d740-4e4c-8301-ef09c9d45165+10:5576:x1876035733816704:12345-192.168.206.40@tcp:101: Request processed in 143us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127224.663036:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 123 00000100:00100000:1.0:1789127224.667042:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127224.667210:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733816832 00000100:00100000:2.0:1789127224.667220:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733816832 00000100:00100000:2.0:1789127224.667281:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 124 00000100:00100000:2.0:1789127224.667290:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7902d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d829a69b-d740-4e4c-8301-ef09c9d45165+10:5576:x1876035733816832:12345-192.168.206.40@tcp:501: 00000100:00100000:2.0:1789127224.667575:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7902d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d829a69b-d740-4e4c-8301-ef09c9d45165+10:5576:x1876035733816832:12345-192.168.206.40@tcp:501: Request processed in 284us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127224.667582:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 124 00000100:00100000:1.0:1789127224.669357:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127224.669434:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733816960 00000100:00100000:3.0:1789127224.669442:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733816960 00000100:00100000:3.0:1789127224.669498:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 125 00000100:00100000:3.0:1789127224.669508:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7902da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d829a69b-d740-4e4c-8301-ef09c9d45165+10:5576:x1876035733816960:12345-192.168.206.40@tcp:503: 00000100:00100000:3.0:1789127224.669883:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7902da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d829a69b-d740-4e4c-8301-ef09c9d45165+10:5576:x1876035733816960:12345-192.168.206.40@tcp:503: Request processed in 376us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127224.669892:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 125 00000100:00100000:3.0:1789127224.672395:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127224.676450:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733817088 00000100:00100000:1.0:1789127224.676474:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733817088 00000100:00100000:1.0:1789127224.676543:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 126 00000100:00100000:1.0:1789127224.676553:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df790dc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d829a69b-d740-4e4c-8301-ef09c9d45165+10:5599:x1876035733817088:12345-192.168.206.40@tcp:502: 00000100:00100000:1.0:1789127224.676815:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df790dc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d829a69b-d740-4e4c-8301-ef09c9d45165+10:5599:x1876035733817088:12345-192.168.206.40@tcp:502: Request processed in 262us (4427us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127224.676823:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 126 00000100:00100000:1.0:1789127224.680101:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127224.680267:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733817216 00000100:00100000:2.0:1789127224.680276:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733817216 00000100:00100000:2.0:1789127224.680329:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 127 00000100:00100000:2.0:1789127224.680339:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df790dc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d829a69b-d740-4e4c-8301-ef09c9d45165+10:5599:x1876035733817216:12345-192.168.206.40@tcp:502: 00000100:00100000:2.0:1789127224.680584:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df790dc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d829a69b-d740-4e4c-8301-ef09c9d45165+10:5599:x1876035733817216:12345-192.168.206.40@tcp:502: Request processed in 245us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127224.680592:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 127 00000100:00100000:3.0:1789127224.684226:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127224.684626:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733817344 00000100:00100000:0.0:1789127224.684637:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733817344 00000100:00100000:0.0:1789127224.684679:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 4 00000100:00100000:0.0:1789127224.684688:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79206da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2345:x1876035733817344:12345-192.168.206.40@tcp:38: 00010000:00080000:0.0:1789127224.684715:0:5831:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from 28762f98-a240-4662-a754-e28bbeb6cb4b@192.168.206.40@tcp t0 exp 0000000000000000 cur 170 last 0 00000020:00000080:0.0:1789127224.684761:0:5831:0:(genops.c:1385:class_connect()) connect: client 28762f98-a240-4662-a754-e28bbeb6cb4b, cookie 0xeeacf7c0243003bd 00000004:00100000:0.0:1789127224.684807:0:5831:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1789127224.684813:0:5831:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:1.0:1789127224.729655:0:5831:0:(import.c:65:import_set_state_nolock()) ffff8df7903a3800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789127224.729756:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79206da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+6:2345:x1876035733817344:12345-192.168.206.40@tcp:38: Request processed in 45066us (45536us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127224.729771:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 4 00010000:00010000:3.0:1789127224.756306:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127225.741915:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127225.741987:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127225.742109:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733817472 00000100:00100000:2.0:1789127225.742118:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733817472 00000100:00080000:0.0:1789127225.742147:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789127225.742187:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733817600 00000100:00100000:2.0:1789127225.742190:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733817600 00000100:00100000:1.0:1789127225.742208:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 5 00000100:00100000:1.0:1789127225.742259:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79206c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+7:0:x1876035733817472:12345-192.168.206.40@tcp:41: 00000004:00000024:1.0:1789127225.742304:0:5830:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1789127225.742427:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79206c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+7:0:x1876035733817472:12345-192.168.206.40@tcp:41: Request processed in 172us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127225.751757:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 5 00000100:00100000:1.0:1789127225.751833:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 6 00000100:00100000:1.0:1789127225.751852:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79206c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+6:5576:x1876035733817600:12345-192.168.206.40@tcp:41: 00000004:00000024:1.0:1789127225.751887:0:5830:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1789127225.751978:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79206c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+6:5576:x1876035733817600:12345-192.168.206.40@tcp:41: Request processed in 136us (9990us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127225.751986:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 6 00000100:00100000:3.0:1789127225.758394:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127225.758494:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733817728 00000100:00100000:0.0:1789127225.758514:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733817728 00000100:00100000:0.0:1789127225.758583:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 7 00000100:00100000:0.0:1789127225.758594:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79206e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+6:5576:x1876035733817728:12345-192.168.206.40@tcp:40: 00000100:00100000:0.0:1789127225.758697:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79206e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+6:5576:x1876035733817728:12345-192.168.206.40@tcp:40: Request processed in 104us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127225.758705:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 7 00000100:00100000:0.0:1789127225.763167:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127225.763219:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127225.763248:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127225.763292:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127225.763357:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733817856 00000100:00100000:2.0:1789127225.763367:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733817856 00000100:00100000:2.0:1789127225.763416:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733817984 00000100:00100000:2.0:1789127225.763419:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733817984 00000100:00100000:3.0:1789127225.763421:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733818112 00000100:00100000:3.0:1789127225.763428:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733818112 00000100:00100000:2.0:1789127225.763441:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 8 00000100:00100000:2.0:1789127225.763450:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeae4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2345:x1876035733817856:12345-192.168.206.40@tcp:8: 00010000:00080000:2.0:1789127225.763479:0:6688:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 28762f98-a240-4662-a754-e28bbeb6cb4b@192.168.206.40@tcp t0 exp 0000000000000000 cur 171 last 0 00000100:00100000:3.0:1789127225.763488:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 0 00000100:00100000:3.0:1789127225.763499:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeae70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+6:5576:x1876035733818112:12345-192.168.206.40@tcp:33: 00000020:00000080:2.0:1789127225.763523:0:6688:0:(genops.c:1385:class_connect()) connect: client 28762f98-a240-4662-a754-e28bbeb6cb4b, cookie 0xeeacf7c0243003c4 00002000:00100000:2.0:1789127225.763536:0:6688:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 28762f98-a240-4662-a754-e28bbeb6cb4b/ffff8df682ada800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113987 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789127225.763582:0:6688:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789127225.764007:0:6688:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:1.0:1789127225.764277:0:8063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 9 00000100:00100000:1.0:1789127225.764283:0:8063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeae6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2345:x1876035733817984:12345-192.168.206.40@tcp:8: 00010000:00080000:1.0:1789127225.764303:0:8063:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 28762f98-a240-4662-a754-e28bbeb6cb4b@192.168.206.40@tcp t0 exp 0000000000000000 cur 171 last 0 00000020:00000080:1.0:1789127225.764323:0:8063:0:(genops.c:1385:class_connect()) connect: client 28762f98-a240-4662-a754-e28bbeb6cb4b, cookie 0xeeacf7c0243003cb 00002000:00100000:1.0:1789127225.764329:0:8063:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 28762f98-a240-4662-a754-e28bbeb6cb4b/ffff8df7903a5000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113987 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789127225.764347:0:8063:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789127225.764688:0:8063:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789127225.764720:0:8063:0:(import.c:65:import_set_state_nolock()) ffff8df7903a6000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789127225.764811:0:8063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeae6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+6:2345:x1876035733817984:12345-192.168.206.40@tcp:8: Request processed in 503us (1540us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127225.764818:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733818240 00000100:00100000:3.0:1789127225.764826:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733818240 00000100:00100000:1.0:1789127225.764830:0:8063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 9 00000100:00100000:3.0:1789127225.764870:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 128 00000100:00100000:3.0:1789127225.764878:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df787bb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d829a69b-d740-4e4c-8301-ef09c9d45165+10:2349:x1876035733818240:12345-192.168.206.40@tcp:400: 00000100:00100000:3.0:1789127225.764909:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df787bb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d829a69b-d740-4e4c-8301-ef09c9d45165+10:2349:x1876035733818240:12345-192.168.206.40@tcp:400: Request processed in 32us (1616us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127225.764916:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 128 00000100:00080000:2.0:1789127225.765376:0:6688:0:(import.c:65:import_set_state_nolock()) ffff8df682ad8000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789127225.765417:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeae4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+6:2345:x1876035733817856:12345-192.168.206.40@tcp:8: Request processed in 1966us (2197us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127225.765424:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 8 00010000:00010000:2.0:1789127225.779081:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789127225.788920:0:5833:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 25348us 00000004:00200000:3.0:1789127225.807267:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1789127225.807445:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeae70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+6:5576:x1876035733818112:12345-192.168.206.40@tcp:33: Request processed in 43942us (44281us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127225.807457:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 0 00000100:00100000:2.0:1789127225.843246:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789127225.843273:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7bfc48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1876035752713728:0@lo:13: 00000100:00100000:2.0:1789127225.843343:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127225.843459:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752713728 00000100:00100000:1.0:1789127225.843467:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752713728 00000100:00100000:1.0:1789127225.843542:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789127225.843551:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df682c73840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876035752713728:12345-0@lo:13: 00002000:00000024:1.0:1789127225.843571:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789127225.843612:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df682c73840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876035752713728:12345-0@lo:13: Request processed in 63us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127225.843618:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1789127225.843755:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789127225.843809:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df7bfc48000 x1876035752713728/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127241 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127225.843819:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1789127225.843837:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7bfc48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1876035752713728:0@lo:13: 00000100:00100000:0.0:1789127225.844574:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7aeae52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1876035752714112:0@lo:400: 00000100:00100000:0.0:1789127225.844611:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127225.844637:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789127225.844641:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7aeae4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876035752713984:0@lo:400: 00000100:00100000:0.0:1789127225.844658:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127225.844679:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752714112 00000100:00100000:0.0:1789127225.844683:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752714112 00000100:00100000:0.0:1789127225.844717:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752713984 00000100:00100000:0.0:1789127225.844719:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752713984 00000100:00100000:0.0:1789127225.844730:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789127225.844736:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7af7cd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876035752714112:12345-0@lo:400: 00000100:00100000:0.0:1789127225.844771:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7af7cd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876035752714112:12345-0@lo:400: Request processed in 34us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127225.844776:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789127225.844811:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789127225.844816:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7af7cfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876035752713984:12345-0@lo:400: 00000100:00100000:0.0:1789127225.844838:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7af7cfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876035752713984:12345-0@lo:400: Request processed in 22us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127225.844843:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:0.0:1789127225.844871:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789127225.844889:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df7aeae4780 x1876035752713984/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127241 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127225.844900:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7aeae4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876035752713984:0@lo:400: 00010000:00080000:0.0:1789127225.844908:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df7aeae52c0 x1876035752714112/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127241 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127225.844915:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7aeae52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1876035752714112:0@lo:400: 00000100:00100000:3.0:1789127225.844986:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7aeae4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752714240:0@lo:400: 00000100:00100000:3.0:1789127225.845020:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127225.845048:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789127225.845053:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7aeae5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3302:1876035752713856:0@lo:400: 00000100:00100000:3.0:1789127225.845091:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127225.845113:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7af7cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1876035752714368:0@lo:400: 00000100:00100000:3.0:1789127225.845131:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127225.845201:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752713856 00000100:00100000:1.0:1789127225.845204:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752713856 00000100:00100000:1.0:1789127225.845233:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1789127225.845239:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df787bbb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:3302:x1876035752713856:12345-0@lo:400: 00000100:00100000:1.0:1789127225.845272:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df787bbb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:3302:x1876035752713856:12345-0@lo:400: Request processed in 33us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127225.845278:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1789127225.845305:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7aeae5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3302:1876035752713856:0@lo:400: 00000100:00100000:0.0:1789127225.845592:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752714368 00000100:00100000:0.0:1789127225.845596:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752714368 00000100:00100000:0.0:1789127225.845634:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789127225.845639:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79206c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876035752714368:12345-0@lo:400: 00000100:00100000:0.0:1789127225.845678:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79206c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876035752714368:12345-0@lo:400: Request processed in 38us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127225.845683:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789127225.845699:0:8063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752714240 00000100:00100000:0.0:1789127225.845702:0:8063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752714240 00000100:00100000:0.0:1789127225.845723:0:8063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789127225.845728:0:8063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79206d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1876035752714240:12345-0@lo:400: 00000100:00100000:0.0:1789127225.845753:0:8063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79206d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1876035752714240:12345-0@lo:400: Request processed in 25us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127225.845759:0:8063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1789127225.845821:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df7af7cc000 x1876035752714368/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127241 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127225.845832:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7af7cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1876035752714368:0@lo:400: 00010000:00080000:3.0:1789127225.845840:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df7aeae4f00 x1876035752714240/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127241 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127225.845848:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7aeae4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752714240:0@lo:400: 00000100:00080000:2.0:1789127225.845895:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789127225.845899:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789127226.034101:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127226.034284:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733818368 00000100:00100000:0.0:1789127226.034294:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733818368 00000100:00100000:0.0:1789127226.034365:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 8 00000100:00100000:0.0:1789127226.034376:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bfc483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+6:5616:x1876035733818368:12345-192.168.206.40@tcp:101: 00010000:00010000:0.0:1789127226.034396:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127226.034499:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df780031400/0xeeacf7c0243003d2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b79ec expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127226.034576:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df780031000/0xeeacf7c0243003d9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127226.034590:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df780031000/0xeeacf7c0243003d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127226.034605:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df780031000/0xeeacf7c0243003d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789127226.034825:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1789127226.034829:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1789127226.034912:0:5830:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df780031000/0xeeacf7c0243003d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127226.034943:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df780031400/0xeeacf7c0243003d2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b79ec expref: 8 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127226.034962:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df780031000/0xeeacf7c0243003d9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b79ec expref: 7 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127226.034971:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df782a68700) 00010000:00010000:0.0:1789127226.034975:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789127226.034978:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df780031000, rc 0) 00000100:00100000:0.0:1789127226.035036:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bfc483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+7:5616:x1876035733818368:12345-192.168.206.40@tcp:101: Request processed in 662us (945us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127226.035043:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 8 00010000:00010000:3.0:1789127226.803075:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127226.867467:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7bfc4a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1876035752714496:0@lo:13: 00000100:00100000:2.0:1789127226.867556:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127226.867643:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752714496 00000100:00100000:2.0:1789127226.867651:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752714496 00000100:00100000:2.0:1789127226.867695:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789127226.867703:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df682c70b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876035752714496:12345-0@lo:13: 00002000:00000024:2.0:1789127226.867738:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789127226.867786:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df682c70b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876035752714496:12345-0@lo:13: Request processed in 82us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127226.867814:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1789127226.867871:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df7bfc4a940 x1876035752714496/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127242 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127226.867889:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7bfc4a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1876035752714496:0@lo:13: 00000001:00100000:2.0:1789127226.946590:0:6714:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 28762f98-a240-4662-a754-e28bbeb6cb4b 00010000:00010000:2.0:1789127227.826939:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127228.161224:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127228.161295:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733818496 00000100:00100000:1.0:1789127228.161305:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733818496 00000100:00100000:1.0:1789127228.161374:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 9 00000100:00100000:1.0:1789127228.161385:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7af7cc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+7:5668:x1876035733818496:12345-192.168.206.40@tcp:41: 00000004:00000024:1.0:1789127228.161436:0:5832:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1789127228.161511:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7af7cc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+7:5668:x1876035733818496:12345-192.168.206.40@tcp:41: Request processed in 128us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127228.161520:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 9 00000100:00080000:2.0:1789127228.161776:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789127228.170391:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127228.170502:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733818624 00000100:00100000:2.0:1789127228.170511:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733818624 00000100:00100000:2.0:1789127228.170580:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 9 00000100:00100000:2.0:1789127228.170591:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79206e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:28762f98-a240-4662-a754-e28bbeb6cb4b+5:5668:x1876035733818624:12345-192.168.206.40@tcp:13: 00002000:00000024:2.0:1789127228.170616:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789127228.170682:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79206e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:28762f98-a240-4662-a754-e28bbeb6cb4b+5:5668:x1876035733818624:12345-192.168.206.40@tcp:13: Request processed in 92us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127228.170689:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 9 00000100:00080000:0.0:1789127228.170762:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789127228.174118:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127228.174261:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733818752 00000100:00100000:2.0:1789127228.174272:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733818752 00000100:00100000:2.0:1789127228.174348:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 10 00000100:00100000:2.0:1789127228.174358:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79206f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:28762f98-a240-4662-a754-e28bbeb6cb4b+6:5668:x1876035733818752:12345-192.168.206.40@tcp:13: 00002000:00000024:2.0:1789127228.174396:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789127228.174470:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79206f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:28762f98-a240-4662-a754-e28bbeb6cb4b+6:5668:x1876035733818752:12345-192.168.206.40@tcp:13: Request processed in 113us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127228.174478:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 10 00000100:00080000:0.0:1789127228.174594:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789127228.862077:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127229.887361:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789127230.038246:0:7646:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 28762f98-a240-4662-a754-e28bbeb6cb4b 00000001:00100000:2.0:1789127230.045124:0:5852:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 28762f98-a240-4662-a754-e28bbeb6cb4b 00000001:02000400:3.0:1789127230.497322:0:8302:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1789127230.901778:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127230.963138:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7bfc4a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876035752714752:0@lo:400: 00000100:00100000:1.0:1789127230.963206:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127230.963270:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7bfc4a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752715264:0@lo:400: 00000100:00100000:1.0:1789127230.963296:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127230.963325:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789127230.963332:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7bfc4ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1876035752714880:0@lo:400: 00000100:00100000:3.0:1789127230.963337:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752714752 00000100:00100000:3.0:1789127230.963346:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752714752 00000100:00100000:1.0:1789127230.963355:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127230.963391:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752714880 00000100:00100000:3.0:1789127230.963394:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752714880 00000100:00100000:0.0:1789127230.963578:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7bfc49680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3301:1876035752714624:0@lo:400: 00000100:00100000:0.0:1789127230.963614:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127230.963655:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7bfc48780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1876035752715136:0@lo:400: 00000100:00100000:0.0:1789127230.963677:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127230.966487:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789127230.966503:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7bfc4b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1876035752715008:0@lo:400: 00000100:00100000:0.0:1789127230.966561:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127230.966584:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752715264 00000100:00100000:2.0:1789127230.966593:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752715264 00000100:00100000:0.0:1789127230.966598:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752715008 00000100:00100000:0.0:1789127230.966603:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752715008 00000100:00100000:2.0:1789127230.966661:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789127230.966672:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bfc4bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1876035752715264:12345-0@lo:400: 00000100:00100000:2.0:1789127230.966733:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bfc4bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1876035752715264:12345-0@lo:400: Request processed in 63us (3434us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127230.966742:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1789127230.966800:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df7bfc4a940 x1876035752715264/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127246 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127230.966815:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7bfc4a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752715264:0@lo:400: 00000100:00100000:0.0:1789127230.966913:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789127230.966921:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7af7cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1876035752715008:12345-0@lo:400: 00000100:00100000:0.0:1789127230.966961:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7af7cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1876035752715008:12345-0@lo:400: Request processed in 41us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127230.966968:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789127230.966988:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752714624 00000100:00100000:0.0:1789127230.966992:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752714624 00000100:00100000:0.0:1789127230.967016:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1789127230.967023:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df787bb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:3301:x1876035752714624:12345-0@lo:400: 00000100:00100000:0.0:1789127230.967052:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df787bb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:3301:x1876035752714624:12345-0@lo:400: Request processed in 29us (3437us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127230.967059:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00010000:00080000:0.0:1789127230.967115:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df7bfc4b840 x1876035752715008/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127246 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127230.967439:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7bfc4b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1876035752715008:0@lo:400: 00000100:00100000:0.0:1789127230.967463:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7bfc49680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3301:1876035752714624:0@lo:400: 00000100:00100000:0.0:1789127230.967612:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7af7cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1876035752715392:0@lo:13: 00000100:00100000:0.0:1789127230.967902:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127230.967945:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752715392 00000100:00100000:0.0:1789127230.967950:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752715392 00000100:00100000:0.0:1789127230.967978:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789127230.967985:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeae4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876035752715392:12345-0@lo:13: 00002000:00000024:0.0:1789127230.968010:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789127230.968043:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeae4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876035752715392:12345-0@lo:13: Request processed in 59us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127230.968049:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1789127230.968085:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df7af7cc000 x1876035752715392/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127246 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127230.968099:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7af7cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1876035752715392:0@lo:13: 00000100:00080000:0.0:1789127230.969272:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789127230.969281:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789127230.969285:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789127230.971380:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752715136 00000100:00100000:1.0:1789127230.971392:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752715136 00000100:00100000:1.0:1789127230.971460:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789127230.971470:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bfc48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876035752714752:12345-0@lo:400: 00000100:00100000:1.0:1789127230.971577:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bfc48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876035752714752:12345-0@lo:400: Request processed in 107us (8370us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127230.971584:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789127230.971600:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789127230.971607:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bfc48b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876035752714880:12345-0@lo:400: 00000100:00100000:1.0:1789127230.971761:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bfc48b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876035752714880:12345-0@lo:400: Request processed in 154us (8405us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127230.971768:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789127230.971782:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789127230.971805:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7af7cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876035752715136:12345-0@lo:400: 00000100:00100000:1.0:1789127230.971841:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7af7cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876035752715136:12345-0@lo:400: Request processed in 53us (8163us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127230.971847:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789127230.971889:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7bfc4ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1876035752714880:0@lo:400: 00000100:00100000:1.0:1789127230.971915:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7bfc4a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876035752714752:0@lo:400: 00000100:00100000:1.0:1789127230.971955:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7bfc48780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1876035752715136:0@lo:400: 00000100:00080000:0.0:1789127230.972043:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789127231.213876:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127231.213923:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127231.213948:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127231.213971:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127231.213994:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733819136 00000100:00100000:1.0:1789127231.214003:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733819136 00000100:00100000:1.0:1789127231.214053:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733819264 00000100:00100000:1.0:1789127231.214056:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733819264 00000100:00100000:1.0:1789127231.214080:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 8 00000100:00100000:1.0:1789127231.214090:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bfc4a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+5:2348:x1876035733819136:12345-192.168.206.40@tcp:400: 00000100:00100000:1.0:1789127231.214153:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bfc4a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+5:2348:x1876035733819136:12345-192.168.206.40@tcp:400: Request processed in 64us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127231.214160:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 8 00000100:00100000:1.0:1789127231.214175:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 9 00000100:00100000:1.0:1789127231.214181:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bfc48f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+5:2348:x1876035733819264:12345-192.168.206.40@tcp:400: 00000100:00100000:1.0:1789127231.214203:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bfc48f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+5:2348:x1876035733819264:12345-192.168.206.40@tcp:400: Request processed in 22us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127231.214209:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 9 00000100:00100000:1.0:1789127231.214225:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733819008 00000100:00100000:1.0:1789127231.214228:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733819008 00000100:00100000:1.0:1789127231.214250:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 25 00000100:00100000:1.0:1789127231.214256:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bfc4ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+6:2348:x1876035733819008:12345-192.168.206.40@tcp:400: 00000100:00100000:1.0:1789127231.214282:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bfc4ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+6:2348:x1876035733819008:12345-192.168.206.40@tcp:400: Request processed in 27us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127231.214295:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 25 00000100:00080000:1.0:1789127231.214314:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789127231.214318:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789127231.214320:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789127231.214424:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733818880 00000100:00100000:0.0:1789127231.214429:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733818880 00000100:00100000:0.0:1789127231.214459:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 131 00000100:00100000:0.0:1789127231.214466:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df787bb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d829a69b-d740-4e4c-8301-ef09c9d45165+10:2348:x1876035733818880:12345-192.168.206.40@tcp:400: 00000100:00100000:0.0:1789127231.214506:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df787bb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d829a69b-d740-4e4c-8301-ef09c9d45165+10:2348:x1876035733818880:12345-192.168.206.40@tcp:400: Request processed in 40us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127231.214512:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 131 00010000:00010000:2.0:1789127231.924136:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127231.989166:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7bfc4a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1876035752715520:0@lo:13: 00000100:00100000:1.0:1789127231.989230:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127231.989302:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752715520 00000100:00100000:1.0:1789127231.989309:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752715520 00000100:00100000:1.0:1789127231.989349:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789127231.989359:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bfc492c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876035752715520:12345-0@lo:13: 00002000:00000024:1.0:1789127231.989392:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789127231.989436:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bfc492c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876035752715520:12345-0@lo:13: Request processed in 78us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127231.989442:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1789127231.989492:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df7bfc4a1c0 x1876035752715520/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127247 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127231.989509:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7bfc4a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1876035752715520:0@lo:13: 00010000:00010000:0.0:1789127232.957168:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127233.970913:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789127233.997655:0:8449:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffda74405e0 20000000:00000080:3.0:1789127233.997673:0:8449:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8df7aeaa3400 uarg=0000000000000000 20000000:01000000:3.0:1789127233.997708:0:8449:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1789127233.997710:0:8449:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1789127233.997713:0:8449:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1789127233.997718:0:8449:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1789127233.997723:0:8449:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1789127233.997736:0:8449:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1789127233.997738:0:8449:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1789127234.001077:0:8449:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789127234.001092:0:8449:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789127234.002355:0:8450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:3.0:1789127234.003050:0:8449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:3.0:1789127234.003106:0:8449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:3.0:1789127234.003145:0:8449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:3.0:1789127234.003158:0:8449:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1789127234.003161:0:8449:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1789127234.004656:0:8451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:3.0:1789127234.007622:0:8449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:3.0:1789127234.007693:0:8449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:3.0:1789127234.007733:0:8449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:3.0:1789127234.007745:0:8449:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1789127234.007748:0:8449:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1789127234.009353:0:8452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1789127234.011619:0:8449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1789127234.011705:0:8449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:1.0:1789127234.011747:0:8449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:1.0:1789127234.011763:0:8449:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1789127234.011766:0:8449:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1789127234.012956:0:8453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:0.0:1789127234.021349:0:8449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:0.0:1789127234.021423:0:8449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:0.0:1789127234.021624:0:8449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 10000000:01000000:0.0:1789127234.021646:0:8449:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789127234.021666:0:8449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8df780031800/0xeeacf7c0243003e0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127234.021683:0:8449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df7c2173000/0xeeacf7c0243002dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c0243002d6 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127234.021691:0:8449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df798df1000/0xeeacf7c024300307 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c024300300 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127234.021698:0:8449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df798df1e00/0xeeacf7c024300331 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c02430032a expref: 18 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127234.021704:0:8449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df798df0e00/0xeeacf7c02430033f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c024300338 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127234.021710:0:8449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df7c2172c00/0xeeacf7c02430034d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c024300346 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127234.021716:0:8449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df7c2051400/0xeeacf7c024300369 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c024300362 expref: 18 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127234.021723:0:8449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df7c2050a00/0xeeacf7c024300393 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c02430038c expref: 18 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127234.021731:0:8449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df780030800/0xeeacf7c0243003a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b798a expref: 9 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127234.021755:0:8449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df798df0200/0xeeacf7c0243003a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7991 expref: 9 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127234.021763:0:8449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8df780031800/0xeeacf7c0243003e0 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127234.021992:0:8449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df798df0200/0xeeacf7c0243003a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7991 expref: 9 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127234.022008:0:8449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df798df0200/0xeeacf7c0243003a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7991 expref: 9 pid: 5824 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127234.022022:0:8449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7aeae5680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1876035752715648:192.168.206.40@tcp:104: 00010000:00010000:0.0:1789127234.022451:0:8449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df780030800/0xeeacf7c0243003a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b798a expref: 9 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127234.022471:0:8449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df780030800/0xeeacf7c0243003a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b798a expref: 9 pid: 5825 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127234.022481:0:8449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7aeae52c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1876035752715776:192.168.206.40@tcp:104: 00010000:00010000:0.0:1789127234.022520:0:8449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df7c2050a00/0xeeacf7c024300393 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xeeacf7c02430038c expref: 18 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127234.022528:0:8449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df7c2050a00/0xeeacf7c024300393 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xeeacf7c02430038c expref: 18 pid: 5822 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127234.022537:0:8449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7aeae4780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1876035752715904:0@lo:104: 00000100:00100000:0.0:1789127234.022575:0:8449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789127234.022645:0:8449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df7c2051400/0xeeacf7c024300369 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xeeacf7c024300362 expref: 18 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127234.022653:0:8449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df7c2051400/0xeeacf7c024300369 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xeeacf7c024300362 expref: 18 pid: 5822 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127234.022660:0:8449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7906292c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1876035752716032:0@lo:104: 00000100:00100000:0.0:1789127234.022688:0:8449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789127234.022720:0:8449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df7c2172c00/0xeeacf7c02430034d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xeeacf7c024300346 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127234.022727:0:8449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df7c2172c00/0xeeacf7c02430034d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xeeacf7c024300346 expref: 18 pid: 5824 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127234.022734:0:8449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df790629e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1876035752716160:0@lo:104: 00010000:00010000:0.0:1789127234.022755:0:8449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df798df0e00/0xeeacf7c02430033f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xeeacf7c024300338 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127234.022761:0:8449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df798df0e00/0xeeacf7c02430033f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xeeacf7c024300338 expref: 18 pid: 5824 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127234.022769:0:8449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df790629a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1876035752716288:0@lo:104: 00010000:00010000:0.0:1789127234.022817:0:8449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df798df1e00/0xeeacf7c024300331 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xeeacf7c02430032a expref: 18 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127234.022825:0:8449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df798df1e00/0xeeacf7c024300331 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xeeacf7c02430032a expref: 18 pid: 5822 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127234.022832:0:8449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df790628000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1876035752716416:0@lo:104: 00010000:00010000:0.0:1789127234.022862:0:8449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df798df1000/0xeeacf7c024300307 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xeeacf7c024300300 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127234.022876:0:8449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df798df1000/0xeeacf7c024300307 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xeeacf7c024300300 expref: 18 pid: 5825 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127234.022883:0:8449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7906283c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1876035752716544:0@lo:104: 00010000:00010000:0.0:1789127234.022909:0:8449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df7c2173000/0xeeacf7c0243002dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xeeacf7c0243002d6 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127234.022917:0:8449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df7c2173000/0xeeacf7c0243002dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xeeacf7c0243002d6 expref: 18 pid: 5824 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127234.022924:0:8449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79062a940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1876035752716672:0@lo:104: 00000100:00100000:0.0:1789127234.022940:0:8449:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7a03349c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789127234.023025:0:5813:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789127234.023044:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127234.023084:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127234.023095:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127234.023104:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127234.023112:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127234.023120:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752715904 00000100:00100000:2.0:1789127234.023126:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752715904 00000100:00100000:2.0:1789127234.023160:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752716032 00000100:00100000:2.0:1789127234.023163:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752716032 00000100:00100000:2.0:1789127234.023187:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752716160 00000100:00100000:2.0:1789127234.023190:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752716160 00000100:00100000:2.0:1789127234.023199:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752716288 00000100:00100000:2.0:1789127234.023201:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752716288 00000100:00100000:2.0:1789127234.023209:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752716416 00000100:00100000:2.0:1789127234.023211:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752716416 00000100:00100000:2.0:1789127234.023218:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752716544 00000100:00100000:2.0:1789127234.023220:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752716544 00000100:00100000:2.0:1789127234.023226:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752716672 00000100:00100000:2.0:1789127234.023228:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752716672 00000100:00100000:2.0:1789127234.023249:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789127234.023257:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7af7cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+9:8449:x1876035752715904:12345-0@lo:104: 00010000:00010000:2.0:1789127234.023270:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.140@tcp lock: ffff8df7c2051e00/0xeeacf7c02430038c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xeeacf7c024300393 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127234.023319:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789127234.023325:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7af7cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+9:8449:x1876035752715904:12345-0@lo:104: Request processed in 69us (750us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127234.023332:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789127234.023346:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789127234.023353:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b4124450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+8:8449:x1876035752716032:12345-0@lo:104: 00010000:00010000:2.0:1789127234.023360:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.140@tcp lock: ffff8df7c2051200/0xeeacf7c024300362 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xeeacf7c024300369 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127234.023389:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789127234.023394:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b4124450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+8:8449:x1876035752716032:12345-0@lo:104: Request processed in 43us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127234.023400:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789127234.023432:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789127234.023438:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df682c73c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+7:8449:x1876035752716160:12345-0@lo:104: 00010000:00010000:2.0:1789127234.023445:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.140@tcp lock: ffff8df798df1200/0xeeacf7c024300346 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xeeacf7c02430034d expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127234.023480:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789127234.023485:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df682c73c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+7:8449:x1876035752716160:12345-0@lo:104: Request processed in 48us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127234.023491:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789127234.023502:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789127234.023514:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df682c70f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+6:8449:x1876035752716288:12345-0@lo:104: 00010000:00010000:2.0:1789127234.023521:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.140@tcp lock: ffff8df780030e00/0xeeacf7c024300338 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xeeacf7c02430033f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127234.023550:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1789127234.023554:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df682c70f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+6:8449:x1876035752716288:12345-0@lo:104: Request processed in 42us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127234.023560:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789127234.023571:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789127234.023576:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df682c73480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+5:8449:x1876035752716416:12345-0@lo:104: 00010000:00010000:2.0:1789127234.023583:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.140@tcp lock: ffff8df7c2173600/0xeeacf7c02430032a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xeeacf7c024300331 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127234.023606:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1789127234.023610:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df682c73480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+5:8449:x1876035752716416:12345-0@lo:104: Request processed in 34us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127234.023615:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789127234.023625:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789127234.023630:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df682c730c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+4:8449:x1876035752716544:12345-0@lo:104: 00010000:00010000:2.0:1789127234.023636:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.140@tcp lock: ffff8df780031600/0xeeacf7c024300300 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xeeacf7c024300307 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127234.023659:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1789127234.023663:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df682c730c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+4:8449:x1876035752716544:12345-0@lo:104: Request processed in 34us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127234.023668:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789127234.023678:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789127234.023690:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df682c72d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+3:8449:x1876035752716672:12345-0@lo:104: 00010000:00010000:2.0:1789127234.023697:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.140@tcp lock: ffff8df7c2051000/0xeeacf7c0243002d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xeeacf7c0243002dd expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127234.023724:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:2.0:1789127234.023728:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df682c72d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+3:8449:x1876035752716672:12345-0@lo:104: Request processed in 40us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127234.023735:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1789127234.023753:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1789127234.023759:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.140@tcp lock: ffff8df7c2051e00/0xeeacf7c02430038c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xeeacf7c024300393 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127234.023766:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7c2051e00 already unused, calling callback (ffffffffc1da1c20) 10000000:00010000:2.0:1789127234.023771:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.140@tcp lock: ffff8df7c2051e00/0xeeacf7c02430038c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xeeacf7c024300393 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127234.023780:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: ffff8df7c2051e00/0xeeacf7c02430038c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xeeacf7c024300393 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789127234.023813:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: ffff8df7c2051e00/0xeeacf7c02430038c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xeeacf7c024300393 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127234.023819:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789127234.023848:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.140@tcp lock: ffff8df7c2051e00/0xeeacf7c02430038c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c024300393 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127234.023855:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789127234.023869:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.140@tcp lock: ffff8df7c2051e00/0xeeacf7c02430038c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c024300393 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127234.023887:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: ffff8df7c2051e00/0xeeacf7c02430038c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c024300393 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127234.023899:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1789127234.023902:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.140@tcp lock: ffff8df7c2051200/0xeeacf7c024300362 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xeeacf7c024300369 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127234.023908:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7c2051200 already unused, calling callback (ffffffffc1da1c20) 10000000:00010000:2.0:1789127234.023911:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.140@tcp lock: ffff8df7c2051200/0xeeacf7c024300362 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xeeacf7c024300369 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127234.023918:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: ffff8df7c2051200/0xeeacf7c024300362 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xeeacf7c024300369 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789127234.023924:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: ffff8df7c2051200/0xeeacf7c024300362 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xeeacf7c024300369 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127234.023929:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789127234.023943:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.140@tcp lock: ffff8df7c2051200/0xeeacf7c024300362 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c024300369 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127234.023950:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789127234.023965:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.140@tcp lock: ffff8df7c2051200/0xeeacf7c024300362 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c024300369 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127234.023972:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: ffff8df7c2051200/0xeeacf7c024300362 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c024300369 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127234.023980:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1789127234.023989:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.140@tcp lock: ffff8df798df1200/0xeeacf7c024300346 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xeeacf7c02430034d expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127234.023995:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df798df1200 already unused, calling callback (ffffffffc1da1c20) 10000000:00010000:2.0:1789127234.023998:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.140@tcp lock: ffff8df798df1200/0xeeacf7c024300346 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xeeacf7c02430034d expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127234.024005:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: ffff8df798df1200/0xeeacf7c024300346 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xeeacf7c02430034d expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789127234.024011:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: ffff8df798df1200/0xeeacf7c024300346 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xeeacf7c02430034d expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127234.024017:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789127234.024030:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.140@tcp lock: ffff8df798df1200/0xeeacf7c024300346 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c02430034d expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127234.024035:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789127234.024040:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.140@tcp lock: ffff8df798df1200/0xeeacf7c024300346 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c02430034d expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127234.024045:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: ffff8df798df1200/0xeeacf7c024300346 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c02430034d expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127234.024054:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789127234.024056:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.140@tcp lock: ffff8df780030e00/0xeeacf7c024300338 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xeeacf7c02430033f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127234.024062:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df780030e00 already unused, calling callback (ffffffffc1da1c20) 10000000:00010000:2.0:1789127234.024065:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.140@tcp lock: ffff8df780030e00/0xeeacf7c024300338 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xeeacf7c02430033f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127234.024081:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: ffff8df780030e00/0xeeacf7c024300338 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xeeacf7c02430033f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789127234.024087:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: ffff8df780030e00/0xeeacf7c024300338 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xeeacf7c02430033f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127234.024092:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789127234.024106:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.140@tcp lock: ffff8df780030e00/0xeeacf7c024300338 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c02430033f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127234.024111:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789127234.024116:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.140@tcp lock: ffff8df780030e00/0xeeacf7c024300338 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c02430033f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127234.024123:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: ffff8df780030e00/0xeeacf7c024300338 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c02430033f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127234.024132:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789127234.024134:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.140@tcp lock: ffff8df7c2173600/0xeeacf7c02430032a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xeeacf7c024300331 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127234.024139:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7c2173600 already unused, calling callback (ffffffffc1da1c20) 10000000:00010000:2.0:1789127234.024142:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.140@tcp lock: ffff8df7c2173600/0xeeacf7c02430032a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xeeacf7c024300331 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127234.024148:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: ffff8df7c2173600/0xeeacf7c02430032a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xeeacf7c024300331 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789127234.024153:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: ffff8df7c2173600/0xeeacf7c02430032a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xeeacf7c024300331 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127234.024165:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789127234.024179:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.140@tcp lock: ffff8df7c2173600/0xeeacf7c02430032a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c024300331 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127234.024184:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789127234.024188:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.140@tcp lock: ffff8df7c2173600/0xeeacf7c02430032a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c024300331 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127234.024194:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: ffff8df7c2173600/0xeeacf7c02430032a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c024300331 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127234.024202:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789127234.024205:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.140@tcp lock: ffff8df780031600/0xeeacf7c024300300 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xeeacf7c024300307 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127234.024210:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df780031600 already unused, calling callback (ffffffffc1da1c20) 10000000:00010000:2.0:1789127234.024212:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.140@tcp lock: ffff8df780031600/0xeeacf7c024300300 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xeeacf7c024300307 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127234.024218:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: ffff8df780031600/0xeeacf7c024300300 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xeeacf7c024300307 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789127234.024222:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: ffff8df780031600/0xeeacf7c024300300 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xeeacf7c024300307 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127234.024227:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789127234.024238:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.140@tcp lock: ffff8df780031600/0xeeacf7c024300300 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c024300307 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127234.024243:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789127234.024252:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.140@tcp lock: ffff8df780031600/0xeeacf7c024300300 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c024300307 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127234.024257:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: ffff8df780031600/0xeeacf7c024300300 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c024300307 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127234.024265:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789127234.024268:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.140@tcp lock: ffff8df7c2051000/0xeeacf7c0243002d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xeeacf7c0243002dd expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127234.024272:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7c2051000 already unused, calling callback (ffffffffc1da1c20) 10000000:00010000:2.0:1789127234.024274:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.140@tcp lock: ffff8df7c2051000/0xeeacf7c0243002d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xeeacf7c0243002dd expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127234.024280:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: ffff8df7c2051000/0xeeacf7c0243002d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xeeacf7c0243002dd expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789127234.024285:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: ffff8df7c2051000/0xeeacf7c0243002d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xeeacf7c0243002dd expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127234.024290:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789127234.024300:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.140@tcp lock: ffff8df7c2051000/0xeeacf7c0243002d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c0243002dd expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127234.024305:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789127234.024309:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.140@tcp lock: ffff8df7c2051000/0xeeacf7c0243002d6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c0243002dd expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127234.024315:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: ffff8df7c2051000/0xeeacf7c0243002d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c0243002dd expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127234.024327:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127234.024333:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127234.024335:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127234.024343:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127234.024359:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df682c70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3303:1876035752717056:0@lo:103: 00000100:00100000:2.0:1789127234.024397:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127234.024418:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a384780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3303:1876035752717568:0@lo:103: 00000100:00100000:2.0:1789127234.024437:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127234.024457:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789127234.024477:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df682c71680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3303:1876035752716928:0@lo:103: 00000100:00100000:2.0:1789127234.024511:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127234.024535:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a385a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3303:1876035752717440:0@lo:103: 00000100:00100000:2.0:1789127234.024555:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127234.024575:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752717056 00000100:00100000:2.0:1789127234.024584:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752717056 00010000:00010000:2.0:1789127234.024607:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df7c2172c00/0xeeacf7c02430034d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xeeacf7c024300346 expref: 19 pid: 5824 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127234.024623:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752717568 00000100:00100000:2.0:1789127234.024626:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752717568 00010000:00010000:2.0:1789127234.024635:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df7c2173000/0xeeacf7c0243002dd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xeeacf7c0243002d6 expref: 20 pid: 5824 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127234.024637:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752716928 00000100:00100000:3.0:1789127234.024640:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752716928 00000100:00100000:2.0:1789127234.024644:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752717440 00000100:00100000:2.0:1789127234.024646:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752717440 00010000:00010000:2.0:1789127234.024653:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df798df1000/0xeeacf7c024300307 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xeeacf7c024300300 expref: 22 pid: 5825 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127234.024654:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df7c2051400/0xeeacf7c024300369 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xeeacf7c024300362 expref: 22 pid: 5822 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127234.024664:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789127234.024668:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789127234.024670:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79a385e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+22:3303:x1876035752717056:12345-0@lo:103: 00000100:00100000:3.0:1789127234.024673:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7af7cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+22:3303:x1876035752717568:12345-0@lo:103: 00010000:00010000:3.0:1789127234.024683:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789127234.024683:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127234.024688:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df7c2173000/0xeeacf7c0243002dd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xeeacf7c0243002d6 expref: 22 pid: 5824 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127234.024688:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df7c2172c00/0xeeacf7c02430034d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xeeacf7c024300346 expref: 22 pid: 5824 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127234.024697:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df7c2172c00/0xeeacf7c02430034d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xeeacf7c024300346 expref: 22 pid: 5824 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127234.024886:0:8449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7aeae4780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1876035752715904:0@lo:104: 00000100:00100000:0.0:1789127234.024897:0:8449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7906292c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1876035752716032:0@lo:104: 00000100:00100000:0.0:1789127234.024905:0:8449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df790629e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1876035752716160:0@lo:104: 00000100:00100000:0.0:1789127234.024912:0:8449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df790629a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1876035752716288:0@lo:104: 00000100:00100000:0.0:1789127234.024920:0:8449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df790628000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1876035752716416:0@lo:104: 00000100:00100000:0.0:1789127234.024927:0:8449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7906283c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1876035752716544:0@lo:104: 00000100:00100000:0.0:1789127234.024935:0:8449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79062a940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1876035752716672:0@lo:104: 00000100:00100000:0.0:1789127234.028676:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df682c71e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3300:1876035752717184:0@lo:103: 00000100:00100000:0.0:1789127234.028751:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127234.028810:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789127234.028817:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df682c712c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3300:1876035752716800:0@lo:103: 00000100:00100000:0.0:1789127234.028837:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127234.028865:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a387480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3300:1876035752717312:0@lo:103: 00000100:00100000:0.0:1789127234.028888:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127234.029897:0:5817:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1789127234.029908:0:5817:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:3.0:1789127234.032750:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df7c2173000/0xeeacf7c0243002dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xeeacf7c0243002d6 expref: 22 pid: 5824 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127234.036630:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df7c2172c00/0xeeacf7c02430034d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xeeacf7c024300346 expref: 22 pid: 5824 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127234.036653:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789127234.036812:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79a385e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+21:3303:x1876035752717056:12345-0@lo:103: Request processed in 12139us (12413us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127234.036822:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789127234.036850:0:5816:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1789127234.036859:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752717184 00000100:00100000:2.0:1789127234.036865:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752717184 00010000:00010000:2.0:1789127234.036888:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df798df0e00/0xeeacf7c02430033f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xeeacf7c024300338 expref: 21 pid: 5824 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127234.036902:0:5816:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1789127234.036907:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752716800 00000100:00100000:2.0:1789127234.036909:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752716800 00010000:00010000:2.0:1789127234.036918:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df7c2050a00/0xeeacf7c024300393 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xeeacf7c02430038c expref: 22 pid: 5822 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127234.036927:0:5816:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1789127234.036931:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752717312 00000100:00100000:2.0:1789127234.036933:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752717312 00010000:00010000:2.0:1789127234.036942:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df798df1e00/0xeeacf7c024300331 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xeeacf7c02430032a expref: 23 pid: 5822 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127234.036971:0:5816:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1789127234.036978:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789127234.036986:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79062c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+23:3303:x1876035752717440:12345-0@lo:103: 00010000:00010000:2.0:1789127234.036998:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789127234.037004:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df798df1000/0xeeacf7c024300307 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xeeacf7c024300300 expref: 23 pid: 5825 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127234.037013:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df798df1000/0xeeacf7c024300307 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xeeacf7c024300300 expref: 23 pid: 5825 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127234.037024:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df798df1000/0xeeacf7c024300307 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xeeacf7c024300300 expref: 23 pid: 5825 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127234.037033:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789127234.037057:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79062c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+22:3303:x1876035752717440:12345-0@lo:103: Request processed in 73us (12501us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127234.037064:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789127234.037096:0:5816:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1789127234.037102:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789127234.037109:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79062da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+21:3303:x1876035752716928:12345-0@lo:103: 00010000:00010000:2.0:1789127234.037116:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789127234.037120:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df7c2051400/0xeeacf7c024300369 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xeeacf7c024300362 expref: 21 pid: 5822 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127234.037127:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df7c2051400/0xeeacf7c024300369 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xeeacf7c024300362 expref: 21 pid: 5822 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127234.037136:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df7c2051400/0xeeacf7c024300369 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xeeacf7c024300362 expref: 21 pid: 5822 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127234.037152:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789127234.037177:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79062da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+20:3303:x1876035752716928:12345-0@lo:103: Request processed in 69us (12665us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127234.037183:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789127234.037307:0:5816:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1789127234.037317:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789127234.037324:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df790629680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:3300:x1876035752717184:12345-0@lo:103: 00010000:00010000:2.0:1789127234.037331:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789127234.037336:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df798df0e00/0xeeacf7c02430033f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xeeacf7c024300338 expref: 19 pid: 5824 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127234.037343:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df798df0e00/0xeeacf7c02430033f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xeeacf7c024300338 expref: 19 pid: 5824 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127234.037352:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df798df0e00/0xeeacf7c02430033f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xeeacf7c024300338 expref: 19 pid: 5824 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127234.037363:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789127234.037397:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df790629680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+18:3300:x1876035752717184:12345-0@lo:103: Request processed in 74us (8646us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127234.037415:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789127234.037427:0:5816:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1789127234.037669:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789127234.037677:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df790628780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+17:3300:x1876035752716800:12345-0@lo:103: 00010000:00010000:2.0:1789127234.037685:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789127234.037689:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df7c2050a00/0xeeacf7c024300393 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xeeacf7c02430038c expref: 17 pid: 5822 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127234.037708:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df7c2050a00/0xeeacf7c024300393 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xeeacf7c02430038c expref: 17 pid: 5822 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127234.037718:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df7c2050a00/0xeeacf7c024300393 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xeeacf7c02430038c expref: 17 pid: 5822 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127234.037726:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789127234.037752:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df790628780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+16:3300:x1876035752716800:12345-0@lo:103: Request processed in 76us (8914us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127234.037758:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789127234.037769:0:5816:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1789127234.037775:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789127234.037781:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7889c9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+15:3300:x1876035752717312:12345-0@lo:103: 00010000:00010000:2.0:1789127234.037810:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789127234.037814:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df798df1e00/0xeeacf7c024300331 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xeeacf7c02430032a expref: 15 pid: 5822 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127234.037821:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df798df1e00/0xeeacf7c024300331 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xeeacf7c02430032a expref: 15 pid: 5822 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127234.037830:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df798df1e00/0xeeacf7c024300331 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xeeacf7c02430032a expref: 15 pid: 5822 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127234.037837:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789127234.037860:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7889c9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+14:3300:x1876035752717312:12345-0@lo:103: Request processed in 79us (8971us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127234.037865:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789127234.037914:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df682c712c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3300:1876035752716800:0@lo:103: 00000100:00100000:2.0:1789127234.037932:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a387480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3300:1876035752717312:0@lo:103: 00000100:00100000:2.0:1789127234.037939:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df682c71e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3300:1876035752717184:0@lo:103: 00000100:00100000:1.0:1789127234.040658:0:8449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7aeae5680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1876035752715648:192.168.206.40@tcp:104: 00000100:00100000:1.0:1789127234.040674:0:8449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7aeae52c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1876035752715776:192.168.206.40@tcp:104: 00010000:00010000:1.0:1789127234.040716:0:8449:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8df780031800/0xeeacf7c0243003e0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127234.042427:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df7c2173000/0xeeacf7c0243002dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xeeacf7c0243002d6 expref: 13 pid: 5824 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127234.042449:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127234.042548:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7af7cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+12:3303:x1876035752717568:12345-0@lo:103: Request processed in 17874us (18109us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127234.042559:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789127234.043293:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df682c70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3303:1876035752717056:0@lo:103: 00000100:00100000:0.0:1789127234.043307:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a384780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3303:1876035752717568:0@lo:103: 00000100:00100000:0.0:1789127234.043331:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df682c71680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3303:1876035752716928:0@lo:103: 00000100:00100000:0.0:1789127234.043339:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a385a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3303:1876035752717440:0@lo:103: 00000100:00100000:1.0:1789127234.044341:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127234.044373:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733819520 00000100:00100000:1.0:1789127234.044377:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127234.044380:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733819520 00010000:00010000:2.0:1789127234.044423:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df780030800/0xeeacf7c0243003a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b798a expref: 10 pid: 5825 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127234.044469:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733819392 00000100:00100000:2.0:1789127234.044473:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733819392 00010000:00010000:2.0:1789127234.044485:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df798df0200/0xeeacf7c0243003a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7991 expref: 11 pid: 5824 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127234.044506:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 19 00000100:00100000:2.0:1789127234.044514:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bfc48780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d829a69b-d740-4e4c-8301-ef09c9d45165+11:2349:x1876035733819520:12345-192.168.206.40@tcp:103: 00010000:00010000:2.0:1789127234.044527:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789127234.044532:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df780030800/0xeeacf7c0243003a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b798a expref: 11 pid: 5825 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127234.044543:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df780030800/0xeeacf7c0243003a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b798a expref: 11 pid: 5825 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127234.044558:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df780030800/0xeeacf7c0243003a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b798a expref: 11 pid: 5825 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127234.044571:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789127234.044617:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bfc48780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d829a69b-d740-4e4c-8301-ef09c9d45165+10:2349:x1876035733819520:12345-192.168.206.40@tcp:103: Request processed in 103us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127234.044624:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 19 00000100:00100000:2.0:1789127234.044653:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 20 00000100:00100000:2.0:1789127234.044661:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bfc4a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d829a69b-d740-4e4c-8301-ef09c9d45165+9:2349:x1876035733819392:12345-192.168.206.40@tcp:103: 00010000:00010000:2.0:1789127234.044669:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789127234.044674:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df798df0200/0xeeacf7c0243003a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7991 expref: 9 pid: 5824 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127234.044684:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df798df0200/0xeeacf7c0243003a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7991 expref: 9 pid: 5824 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127234.044694:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df798df0200/0xeeacf7c0243003a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7991 expref: 9 pid: 5824 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127234.044708:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8df780031800/0xeeacf7c0243003e0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127234.044716:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df780031800/0xeeacf7c0243003e0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127234.044730:0:5816:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df780031800/0xeeacf7c0243003e0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127234.044737:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df780031800/0xeeacf7c0243003e0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127234.044743:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8df780031800/0xeeacf7c0243003e0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127234.044750:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8df780031800/0xeeacf7c0243003e0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127234.044756:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df780031800 already unused, calling callback (ffffffffc17a4550) 00010000:00010000:2.0:1789127234.044765:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8df780031800/0xeeacf7c0243003e0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127234.044774:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8df780031800/0xeeacf7c0243003e0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127234.044786:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8df780031800/0xeeacf7c0243003e0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127234.044847:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789127234.044868:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bfc4a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d829a69b-d740-4e4c-8301-ef09c9d45165+8:2349:x1876035733819392:12345-192.168.206.40@tcp:103: Request processed in 208us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127234.044875:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 20 00010000:00010000:1.0:1789127234.045277:0:8449:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8df780031800/0xeeacf7c0243003e0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127234.045286:0:8449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8df780031800/0xeeacf7c0243003e0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127234.045291:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df780031800/0xeeacf7c0243003e0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127234.995624:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127235.047894:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127235.047977:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733819648 00000100:00100000:0.0:1789127235.047986:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733819648 00000100:00100000:0.0:1789127235.048039:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 132 00000100:00100000:0.0:1789127235.048047:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df787bb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d829a69b-d740-4e4c-8301-ef09c9d45165+8:5590:x1876035733819648:12345-192.168.206.40@tcp:101: 00010000:00010000:0.0:1789127235.048061:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127235.048078:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df780031800/0xeeacf7c0243003e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b79f3 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127235.048101:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df780031800/0xeeacf7c0243003e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b79f3 expref: 9 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127235.048111:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df780031800/0xeeacf7c0243003e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b79f3 expref: 9 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127235.048119:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df780031800, rc 0) 00000100:00100000:0.0:1789127235.048169:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df787bb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d829a69b-d740-4e4c-8301-ef09c9d45165+9:5590:x1876035733819648:12345-192.168.206.40@tcp:101: Request processed in 123us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127235.048175:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 132 00000100:00100000:2.0:1789127235.051318:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127235.051708:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733819776 00000100:00100000:0.0:1789127235.051721:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733819776 00000100:00100000:0.0:1789127235.052042:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 133 00000100:00100000:0.0:1789127235.052055:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df787bb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d829a69b-d740-4e4c-8301-ef09c9d45165+9:5590:x1876035733819776:12345-192.168.206.40@tcp:501: 00000100:00100000:0.0:1789127235.052639:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df787bb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d829a69b-d740-4e4c-8301-ef09c9d45165+9:5590:x1876035733819776:12345-192.168.206.40@tcp:501: Request processed in 584us (1331us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127235.052649:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 133 00000100:00100000:0.0:1789127235.066732:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127235.067318:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733819904 00000100:00100000:1.0:1789127235.067331:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733819904 00000100:00100000:1.0:1789127235.067403:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 134 00000100:00100000:1.0:1789127235.067425:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df787bbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d829a69b-d740-4e4c-8301-ef09c9d45165+9:5590:x1876035733819904:12345-192.168.206.40@tcp:503: 00000100:00100000:1.0:1789127235.067694:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df787bbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d829a69b-d740-4e4c-8301-ef09c9d45165+9:5590:x1876035733819904:12345-192.168.206.40@tcp:503: Request processed in 280us (976us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127235.067704:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 134 00000100:00100000:1.0:1789127235.085731:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127235.085976:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733820032 00000100:00100000:0.0:1789127235.085988:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733820032 00000100:00100000:0.0:1789127235.086051:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 135 00000100:00100000:0.0:1789127235.086063:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df787bba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d829a69b-d740-4e4c-8301-ef09c9d45165+9:6056:x1876035733820032:12345-192.168.206.40@tcp:502: 00000100:00100000:0.0:1789127235.086681:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df787bba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d829a69b-d740-4e4c-8301-ef09c9d45165+9:6056:x1876035733820032:12345-192.168.206.40@tcp:502: Request processed in 616us (962us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127235.086692:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 135 00000100:00100000:1.0:1789127235.091669:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127235.091766:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733820160 00000100:00100000:0.0:1789127235.091779:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733820160 00000100:00100000:0.0:1789127235.091867:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 136 00000100:00100000:0.0:1789127235.091879:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df787bb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d829a69b-d740-4e4c-8301-ef09c9d45165+9:6056:x1876035733820160:12345-192.168.206.40@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789127235.092199:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df787bb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d829a69b-d740-4e4c-8301-ef09c9d45165+9:6056:x1876035733820160:12345-192.168.206.40@tcp:502:llog_process_th.0 Request processed in 321us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127235.092209:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 136 00000100:00100000:2.0:1789127235.097905:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127235.098130:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733820288 00000100:00100000:0.0:1789127235.098142:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733820288 00000100:00100000:0.0:1789127235.098363:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 137 00000100:00100000:0.0:1789127235.098374:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df788035050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d829a69b-d740-4e4c-8301-ef09c9d45165+9:5590:x1876035733820288:12345-192.168.206.40@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789127235.098405:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127235.098428:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df780030800/0xeeacf7c0243003ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b79fa expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127235.098470:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df780030800/0xeeacf7c0243003ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b79fa expref: 10 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127235.098483:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df780030800/0xeeacf7c0243003ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b79fa expref: 10 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127235.098589:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df780030800, rc 0) 00000100:00100000:0.0:1789127235.098727:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df788035050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d829a69b-d740-4e4c-8301-ef09c9d45165+10:5590:x1876035733820288:12345-192.168.206.40@tcp:101:ll_cfg_requeue.0 Request processed in 354us (835us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127235.098736:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 137 00000100:00100000:1.0:1789127235.103238:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127235.103982:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733820416 00000100:00100000:2.0:1789127235.103995:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733820416 00000100:00100000:2.0:1789127235.104059:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 138 00000100:00100000:2.0:1789127235.104071:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df788035850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d829a69b-d740-4e4c-8301-ef09c9d45165+10:5590:x1876035733820416:12345-192.168.206.40@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789127235.104368:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df788035850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d829a69b-d740-4e4c-8301-ef09c9d45165+10:5590:x1876035733820416:12345-192.168.206.40@tcp:501:ll_cfg_requeue.0 Request processed in 297us (1142us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789127235.104378:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 138 10000000:01000000:0.0:1789127235.123075:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789127235.123085:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8df7b45fe800 from 39 10000000:01000000:0.0:1789127235.123093:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789127235.123157:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df780031600/0xeeacf7c0243003f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127235.123355:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff8df780031600/0xeeacf7c0243003f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127235.123369:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff8df780031600/0xeeacf7c0243003f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127235.123399:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79062a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752717696:0@lo:101: 00000100:00100000:0.0:1789127235.123633:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127235.123751:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df78eee5480 going to sleep for 11 seconds 00000100:00100000:2.0:1789127235.123959:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752717696 00000100:00100000:2.0:1789127235.123967:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752717696 00000100:00100000:2.0:1789127235.124028:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789127235.124038:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df788034050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+12:5827:x1876035752717696:12345-0@lo:101: 00010000:00010000:2.0:1789127235.124056:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127235.124078:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df79032cc00/0xeeacf7c0243003fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xeeacf7c0243003f5 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127235.124108:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df79032cc00/0xeeacf7c0243003fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xeeacf7c0243003f5 expref: 13 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127235.124121:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df79032cc00/0xeeacf7c0243003fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c0243003f5 expref: 13 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127235.124133:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df79032cc00, rc 0) 00000100:00100000:2.0:1789127235.124296:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df788034050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+13:5827:x1876035752717696:12345-0@lo:101: Request processed in 258us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127235.124304:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789127235.124740:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79062a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752717696:0@lo:101: 00010000:00010000:0.0:1789127235.124761:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff8df780031600/0xeeacf7c0243003f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c0243003fc expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127235.124771:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff8df780031600/0xeeacf7c0243003f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xeeacf7c0243003fc expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127235.124879:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79062a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752717824:0@lo:501: 00000100:00100000:0.0:1789127235.124919:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127235.124999:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752717824 00000100:00100000:3.0:1789127235.125005:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752717824 00000100:00100000:3.0:1789127235.125041:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789127235.125048:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df788035450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+13:5827:x1876035752717824:12345-0@lo:501: 00000100:00100000:3.0:1789127235.125357:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df788035450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+13:5827:x1876035752717824:12345-0@lo:501: Request processed in 307us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127235.125365:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789127235.126521:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df78eee5480 going to sleep for 11 seconds 00000100:00100000:0.0:1789127235.126552:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79062a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752717824:0@lo:501: 00000100:00100000:0.0:1789127235.126605:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79062a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752717952:0@lo:503: 00000100:00100000:0.0:1789127235.126669:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127235.126741:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752717952 00000100:00100000:3.0:1789127235.126747:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752717952 00000100:00100000:3.0:1789127235.126825:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789127235.126834:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df788036c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+13:5827:x1876035752717952:12345-0@lo:503: 00000100:00100000:3.0:1789127235.127406:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df788036c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+13:5827:x1876035752717952:12345-0@lo:503: Request processed in 571us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127235.127415:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1789127235.131142:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df78eee5480 going to sleep for 11 seconds 00000100:00100000:0.0:1789127235.131208:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79062a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752717952:0@lo:503: 00000100:00100000:0.0:1789127235.131909:0:8467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79062a580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:8467:1876035752718080:0@lo:502: 00000100:00100000:0.0:1789127235.131997:0:8467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127235.132092:0:8467:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df78eee5300 going to sleep for 11 seconds 00000100:00100000:1.0:1789127235.132153:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752718080 00000100:00100000:1.0:1789127235.132219:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752718080 00000100:00100000:1.0:1789127235.132326:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789127235.132336:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df788036850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+13:8467:x1876035752718080:12345-0@lo:502: 00000100:00100000:1.0:1789127235.132688:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df788036850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+13:8467:x1876035752718080:12345-0@lo:502: Request processed in 352us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127235.132703:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789127235.132782:0:8467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79062a580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:8467:1876035752718080:0@lo:502: 00000100:00100000:0.0:1789127235.132860:0:8467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79062a580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:8467:1876035752718208:0@lo:502: 00000100:00100000:0.0:1789127235.132896:0:8467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127235.133730:0:8467:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df78eee5300 going to sleep for 11 seconds 00000100:00100000:2.0:1789127235.134140:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752718208 00000100:00100000:2.0:1789127235.134147:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752718208 00000100:00100000:2.0:1789127235.134198:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789127235.134206:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df788035c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+13:8467:x1876035752718208:12345-0@lo:502: 00000100:00100000:0.0:1789127235.135281:0:8467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79062a580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:8467:1876035752718208:0@lo:502: 00000040:00080000:0.0:1789127235.135330:0:8467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000100:00100000:2.0:1789127235.135331:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df788035c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+13:8467:x1876035752718208:12345-0@lo:502: Request processed in 1125us (2433us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127235.135341:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000020:01000000:1.0:1789127235.135580:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1789127235.135710:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789127235.135724:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df780031600/0xeeacf7c0243003f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c0243003fc expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127235.135737:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff8df780031600/0xeeacf7c0243003f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c0243003fc expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789127235.135748:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1789127235.135752:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1789127235.135755:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1789127235.135815:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df7bbd96c00/0xeeacf7c024300403 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127235.135824:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff8df7bbd96c00/0xeeacf7c024300403 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127235.135834:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff8df7bbd96c00/0xeeacf7c024300403 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127235.135854:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7bfc49a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752718336:0@lo:101: 00000100:00100000:1.0:1789127235.135905:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127235.136327:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df787750b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789127235.136397:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752718336 00000100:00100000:3.0:1789127235.136403:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752718336 00000100:00100000:3.0:1789127235.136720:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789127235.136730:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df788036450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+13:5827:x1876035752718336:12345-0@lo:101: 00010000:00010000:3.0:1789127235.136745:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127235.136760:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df798df1600/0xeeacf7c02430040a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xeeacf7c024300403 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127235.136823:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df798df1600/0xeeacf7c02430040a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xeeacf7c024300403 expref: 14 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127235.136836:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df798df1600/0xeeacf7c02430040a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c024300403 expref: 14 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127235.136845:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df798df1600, rc 0) 00000100:00100000:3.0:1789127235.136923:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df788036450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+14:5827:x1876035752718336:12345-0@lo:101: Request processed in 186us (1008us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127235.136937:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1789127235.137005:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7bfc49a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752718336:0@lo:101: 00010000:00010000:1.0:1789127235.137021:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff8df7bbd96c00/0xeeacf7c024300403 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c02430040a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127235.137032:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff8df7bbd96c00/0xeeacf7c024300403 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xeeacf7c02430040a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127235.137120:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7bfc49a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752718464:0@lo:501: 00000100:00100000:1.0:1789127235.137150:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127235.138482:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df787750b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789127235.138745:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752718464 00000100:00100000:3.0:1789127235.138753:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752718464 00000100:00100000:3.0:1789127235.139134:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1789127235.139147:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df788034c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+14:5827:x1876035752718464:12345-0@lo:501: 00000100:00100000:3.0:1789127235.145553:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df788034c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+14:5827:x1876035752718464:12345-0@lo:501: Request processed in 6339us (8332us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127235.145572:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789127235.145572:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7bfc49a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752718464:0@lo:501: 00000100:00100000:1.0:1789127235.145640:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7bfc49a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752718592:0@lo:503: 00000100:00100000:1.0:1789127235.145708:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127235.145749:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df787750b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789127235.145869:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752718592 00000100:00100000:0.0:1789127235.145885:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752718592 00000100:00100000:0.0:1789127235.145939:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789127235.145950:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df788037c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+14:5827:x1876035752718592:12345-0@lo:503: 00000100:00100000:0.0:1789127235.146195:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df788037c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+14:5827:x1876035752718592:12345-0@lo:503: Request processed in 247us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127235.146203:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789127235.146373:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7bfc49a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752718592:0@lo:503: 00000100:00100000:2.0:1789127235.151295:0:8468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79062c3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:8468:1876035752718720:0@lo:502: 00000100:00100000:2.0:1789127235.151416:0:8468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127235.151624:0:8468:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7833fa600 going to sleep for 11 seconds 00000100:00100000:3.0:1789127235.153007:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752718720 00000100:00100000:3.0:1789127235.153031:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752718720 00000100:00100000:3.0:1789127235.153104:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789127235.153116:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df788036050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+14:8468:x1876035752718720:12345-0@lo:502: 00000100:00100000:3.0:1789127235.153462:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df788036050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+14:8468:x1876035752718720:12345-0@lo:502: Request processed in 338us (2036us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127235.153471:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789127235.153778:0:8468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79062c3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:8468:1876035752718720:0@lo:502: 00000020:01000000:0.0:1789127235.153849:0:8468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789127235.153861:0:8468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127235.153864:0:8468:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789127235.153870:0:8468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1789127235.153908:0:8468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79062a580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:8468:1876035752718848:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789127235.153959:0:8468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127235.153991:0:8468:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df78eee5480 going to sleep for 11 seconds 00000100:00100000:1.0:1789127235.154060:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752718848 00000100:00100000:1.0:1789127235.154065:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752718848 00000100:00100000:1.0:1789127235.154090:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789127235.154098:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df788037450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+14:8468:x1876035752718848:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789127235.154264:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df788037450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+14:8468:x1876035752718848:12345-0@lo:502:llog_process_th.0 Request processed in 165us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127235.154271:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789127235.154872:0:8468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79062a580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:8468:1876035752718848:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789127235.154896:0:8468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789127235.154903:0:8468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127235.154905:0:8468:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789127235.154909:0:8468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:1.0:1789127235.155142:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1789127235.155182:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1789127235.155193:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df7bbd96c00/0xeeacf7c024300403 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c02430040a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127235.155206:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff8df7bbd96c00/0xeeacf7c024300403 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c02430040a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789127235.155218:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789127235.155221:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8df788896800 from 39 10000000:01000000:1.0:1789127235.155233:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789127235.155266:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df7bbd97000/0xeeacf7c024300411 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127235.155275:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff8df7bbd97000/0xeeacf7c024300411 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127235.155285:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff8df7bbd97000/0xeeacf7c024300411 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127235.155304:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7bfc49a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752718976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789127235.155356:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127235.155392:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df787750000 going to sleep for 11 seconds 00000100:00100000:0.0:1789127235.155894:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752718976 00000100:00100000:0.0:1789127235.155900:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752718976 00000100:00100000:0.0:1789127235.155934:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789127235.155943:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df788034450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+14:5827:x1876035752718976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789127235.155955:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127235.155971:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df780030e00/0xeeacf7c024300418 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xeeacf7c024300411 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127235.155998:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df780030e00/0xeeacf7c024300418 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xeeacf7c024300411 expref: 15 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127235.156029:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df780030e00/0xeeacf7c024300418 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c024300411 expref: 15 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127235.156040:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df780030e00, rc 0) 00000100:00100000:0.0:1789127235.156083:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df788034450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+15:5827:x1876035752718976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127235.156090:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789127235.156358:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7bfc49a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752718976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789127235.156375:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff8df7bbd97000/0xeeacf7c024300411 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c024300418 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127235.156385:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff8df7bbd97000/0xeeacf7c024300411 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xeeacf7c024300418 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127235.156517:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7bfc49a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752719104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789127235.156607:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127235.156821:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df787750000 going to sleep for 11 seconds 00000100:00100000:3.0:1789127235.157171:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752719104 00000100:00100000:3.0:1789127235.157177:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752719104 00000100:00100000:3.0:1789127235.157209:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789127235.157218:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df788037850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+15:5827:x1876035752719104:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789127235.157753:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df788037850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+15:5827:x1876035752719104:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 534us (1144us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127235.157762:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789127235.157872:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7bfc49a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752719104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789127235.157915:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7bfc49a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752719232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789127235.157961:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127235.157992:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df787750000 going to sleep for 11 seconds 00000100:00100000:3.0:1789127235.158153:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752719232 00000100:00100000:3.0:1789127235.158168:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752719232 00000100:00100000:3.0:1789127235.158202:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789127235.158209:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df788034850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+15:5827:x1876035752719232:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789127235.158373:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df788034850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+15:5827:x1876035752719232:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 163us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127235.158592:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7bfc49a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752719232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789127235.158824:0:8469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7bfc49a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:8469:1876035752719360:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789127235.158864:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127235.158887:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752719360 00000100:00100000:1.0:1789127235.158891:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752719360 00000100:00100000:1.0:1789127235.158911:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789127235.158917:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df788037050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+16:8469:x1876035752719360:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789127235.159160:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df788037050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+16:8469:x1876035752719360:12345-0@lo:502:llog_process_th.0 Request processed in 242us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127235.159168:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789127235.159201:0:8469:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df787750240 going to sleep for 11 seconds 00000100:00100000:1.0:1789127235.159213:0:8469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7bfc49a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:8469:1876035752719360:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789127235.159250:0:8469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7bfc49a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:8469:1876035752719488:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789127235.159281:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127235.159301:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752719488 00000100:00100000:1.0:1789127235.159305:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752719488 00000100:00100000:1.0:1789127235.159320:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789127235.159325:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7906c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+16:8469:x1876035752719488:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789127235.159700:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789127235.159990:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7906c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+15:8469:x1876035752719488:12345-0@lo:502:llog_process_th.0 Request processed in 663us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127235.159997:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789127235.160092:0:8469:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7a0334180 going to sleep for 11 seconds 00000100:00100000:1.0:1789127235.160105:0:8469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7bfc49a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:8469:1876035752719488:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789127235.160126:0:8469:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1789127235.161377:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1789127235.161419:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789127235.161594:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df7bbd97000/0xeeacf7c024300411 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c024300418 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127235.161607:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff8df7bbd97000/0xeeacf7c024300411 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c024300418 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127235.161631:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1789127235.161634:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1789127235.161638:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789127235.161676:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df79032c600/0xeeacf7c02430041f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127235.161686:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff8df79032c600/0xeeacf7c02430041f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127235.161697:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff8df79032c600/0xeeacf7c02430041f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127235.161727:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79062e940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752719616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789127235.161784:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127235.161894:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7833fa0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789127235.162076:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752719616 00000100:00100000:3.0:1789127235.162084:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752719616 00000100:00100000:3.0:1789127235.162214:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789127235.162336:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7906c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+15:5827:x1876035752719616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789127235.162351:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127235.162368:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df798df0a00/0xeeacf7c024300426 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xeeacf7c02430041f expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127235.162396:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df798df0a00/0xeeacf7c024300426 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xeeacf7c02430041f expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127235.162408:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df798df0a00/0xeeacf7c024300426 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c02430041f expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127235.162543:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df798df0a00, rc 0) 00000100:00100000:3.0:1789127235.162646:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7906c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+16:5827:x1876035752719616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 314us (861us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127235.162654:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789127235.163114:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79062e940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752719616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789127235.163134:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff8df79032c600/0xeeacf7c02430041f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c024300426 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127235.163146:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff8df79032c600/0xeeacf7c02430041f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xeeacf7c024300426 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127235.163390:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7bfc49a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752719744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789127235.163435:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127235.165574:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7a0334180 going to sleep for 11 seconds 00000100:00100000:2.0:1789127235.166053:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752719744 00000100:00100000:2.0:1789127235.166063:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752719744 00000100:00100000:2.0:1789127235.166124:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789127235.166134:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7906c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+16:5827:x1876035752719744:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789127235.166953:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7906c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+16:5827:x1876035752719744:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 816us (3512us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127235.166963:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789127235.167362:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7bfc49a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752719744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789127235.167554:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7bfc49a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752719872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789127235.167727:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127235.167764:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7a0334180 going to sleep for 11 seconds 00000100:00100000:3.0:1789127235.167777:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752719872 00000100:00100000:3.0:1789127235.167784:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752719872 00000100:00100000:3.0:1789127235.167855:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789127235.167863:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7906c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+16:5827:x1876035752719872:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789127235.168053:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7906c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+16:5827:x1876035752719872:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 190us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127235.168070:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789127235.168301:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7bfc49a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752719872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789127235.169145:0:8470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7bfc49a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:8470:1876035752720000:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789127235.169201:0:8470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127235.169554:0:8470:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7a0334780 going to sleep for 11 seconds 00000100:00100000:3.0:1789127235.170762:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752720000 00000100:00100000:3.0:1789127235.171002:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752720000 00000100:00100000:1.0:1789127235.171202:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789127235.171215:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7906cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+16:8470:x1876035752720000:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789127235.171552:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7906cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+16:8470:x1876035752720000:12345-0@lo:502:llog_process_th.0 Request processed in 340us (2350us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127235.171560:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789127235.171755:0:8470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7bfc49a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:8470:1876035752720000:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789127235.172214:0:8470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789127235.172227:0:8470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127235.172229:0:8470:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789127235.172236:0:8470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789127235.172281:0:8470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79206f0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:8470:1876035752720128:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789127235.172336:0:8470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127235.172373:0:8470:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7988fb3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789127235.172444:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752720128 00000100:00100000:2.0:1789127235.172451:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752720128 00000100:00100000:2.0:1789127235.172499:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789127235.172507:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7906ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+16:8470:x1876035752720128:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789127235.172695:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7906ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+16:8470:x1876035752720128:12345-0@lo:502:llog_process_th.0 Request processed in 188us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127235.172710:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789127235.172860:0:8470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79206f0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:8470:1876035752720128:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789127235.172889:0:8470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789127235.172894:0:8470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127235.172896:0:8470:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789127235.172902:0:8470:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:2.0:1789127235.173126:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1789127235.173152:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1789127235.173163:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df79032c600/0xeeacf7c02430041f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c024300426 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127235.173176:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff8df79032c600/0xeeacf7c02430041f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c024300426 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127235.173187:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789127235.173190:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8df788820800 from 39 10000000:01000000:2.0:1789127235.173193:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789127235.173223:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df79032d000/0xeeacf7c02430042d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127235.173232:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff8df79032d000/0xeeacf7c02430042d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127235.173242:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff8df79032d000/0xeeacf7c02430042d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127235.173260:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79062d680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752720256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789127235.173295:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127235.173648:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7833fac00 going to sleep for 11 seconds 00000100:00100000:3.0:1789127235.174376:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752720256 00000100:00100000:3.0:1789127235.174385:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752720256 00000100:00100000:2.0:1789127235.174516:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789127235.174537:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7906c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+16:5827:x1876035752720256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789127235.174550:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127235.174567:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df79032d600/0xeeacf7c024300434 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xeeacf7c02430042d expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127235.174609:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df79032d600/0xeeacf7c024300434 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xeeacf7c02430042d expref: 17 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127235.174621:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df79032d600/0xeeacf7c024300434 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c02430042d expref: 17 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127235.174631:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df79032d600, rc 0) 00000100:00100000:2.0:1789127235.174693:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7906c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+17:5827:x1876035752720256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 158us (1397us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127235.174700:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789127235.175075:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79062d680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752720256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789127235.175095:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff8df79032d000/0xeeacf7c02430042d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c024300434 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127235.175105:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff8df79032d000/0xeeacf7c02430042d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xeeacf7c024300434 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127235.175176:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79062a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752720384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789127235.175212:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127235.175235:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df78eee56c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789127235.175332:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752720384 00000100:00100000:2.0:1789127235.175337:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752720384 00000100:00100000:2.0:1789127235.175358:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789127235.175364:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7906ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+17:5827:x1876035752720384:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789127235.175837:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7906ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+17:5827:x1876035752720384:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 471us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127235.175846:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789127235.175983:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79062a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752720384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789127235.176027:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79062a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752720512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789127235.176074:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127235.176091:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df78eee56c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789127235.176176:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752720512 00000100:00100000:2.0:1789127235.176181:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752720512 00000100:00100000:2.0:1789127235.176216:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789127235.176223:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7906c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+17:5827:x1876035752720512:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789127235.176384:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7906c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+17:5827:x1876035752720512:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 158us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127235.176392:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1789127235.176560:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79062a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752720512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789127235.177151:0:8471:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79062c780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:8471:1876035752720640:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789127235.177205:0:8471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127235.177240:0:8471:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7833fa180 going to sleep for 11 seconds 00000100:00100000:0.0:1789127235.177287:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752720640 00000100:00100000:0.0:1789127235.177292:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752720640 00000100:00100000:0.0:1789127235.177366:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789127235.177531:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7906cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+17:8471:x1876035752720640:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789127235.177744:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7906cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+17:8471:x1876035752720640:12345-0@lo:502:llog_process_th.0 Request processed in 371us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127235.177752:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789127235.177982:0:8471:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79062c780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:8471:1876035752720640:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789127235.178040:0:8471:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79062c780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:8471:1876035752720768:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789127235.178077:0:8471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127235.178103:0:8471:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7833fa180 going to sleep for 11 seconds 00000100:00100000:1.0:1789127235.178319:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752720768 00000100:00100000:1.0:1789127235.178325:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752720768 00000100:00100000:1.0:1789127235.178352:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1789127235.178359:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7906ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+17:8471:x1876035752720768:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789127235.179111:0:8471:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79062c780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:8471:1876035752720768:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789127235.179137:0:8471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000100:00100000:1.0:1789127235.179143:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7906ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+17:8471:x1876035752720768:12345-0@lo:502:llog_process_th.0 Request processed in 675us (955us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127235.179151:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000020:01000000:0.0:1789127235.179309:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1789127235.179329:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789127235.179341:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df79032d000/0xeeacf7c02430042d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c024300434 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127235.179353:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff8df79032d000/0xeeacf7c02430042d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c024300434 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127235.179364:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1789127235.179367:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1789127235.179370:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789127235.179402:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df780031400/0xeeacf7c02430043b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127235.179410:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff8df780031400/0xeeacf7c02430043b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127235.179419:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff8df780031400/0xeeacf7c02430043b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127235.179504:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79062a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752720896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789127235.179607:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127235.179707:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df78eee56c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789127235.182075:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752720896 00000100:00100000:3.0:1789127235.182090:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752720896 00000100:00100000:2.0:1789127235.182269:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1789127235.182281:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7906cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+17:5827:x1876035752720896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789127235.182300:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127235.182321:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df79032d400/0xeeacf7c024300442 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xeeacf7c02430043b expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127235.182353:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df79032d400/0xeeacf7c024300442 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xeeacf7c02430043b expref: 18 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127235.182369:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df79032d400/0xeeacf7c024300442 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c02430043b expref: 18 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127235.182380:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df79032d400, rc 0) 00000100:00100000:2.0:1789127235.182479:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7906cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+18:5827:x1876035752720896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 200us (2871us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127235.182486:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789127235.182714:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79062a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752720896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789127235.182734:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff8df780031400/0xeeacf7c02430043b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c024300442 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127235.182745:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff8df780031400/0xeeacf7c02430043b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xeeacf7c024300442 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127235.182852:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79206cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752721024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789127235.182889:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127235.182916:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df785497c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789127235.183299:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752721024 00000100:00100000:1.0:1789127235.183306:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752721024 00000100:00100000:1.0:1789127235.183342:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1789127235.183351:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7906c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+18:5827:x1876035752721024:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789127235.183963:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7906c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+18:5827:x1876035752721024:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 611us (1071us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127235.183971:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1789127235.184110:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79206cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752721024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789127235.184154:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79206cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752721152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789127235.184206:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127235.184284:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df785497c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789127235.184328:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752721152 00000100:00100000:0.0:1789127235.184340:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752721152 00000100:00100000:0.0:1789127235.184405:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1789127235.184413:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7906cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+18:5827:x1876035752721152:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789127235.184651:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7906cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+18:5827:x1876035752721152:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 238us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127235.184658:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1789127235.184835:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79206cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752721152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789127235.185578:0:8472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79206cf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:8472:1876035752721280:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789127235.185634:0:8472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127235.185667:0:8472:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7854970c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789127235.185719:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752721280 00000100:00100000:1.0:1789127235.185725:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752721280 00000100:00100000:1.0:1789127235.185762:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1789127235.185770:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7906c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+18:8472:x1876035752721280:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789127235.185997:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7906c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+18:8472:x1876035752721280:12345-0@lo:502:llog_process_th.0 Request processed in 226us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127235.186004:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1789127235.186189:0:8472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79206cf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:8472:1876035752721280:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789127235.186214:0:8472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789127235.186224:0:8472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127235.186226:0:8472:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789127235.186234:0:8472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789127235.186258:0:8472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79206cf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:8472:1876035752721408:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789127235.186292:0:8472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127235.186349:0:8472:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7854970c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789127235.187142:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752721408 00000100:00100000:2.0:1789127235.187150:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752721408 00000100:00100000:2.0:1789127235.187205:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1789127235.187214:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7906cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+18:8472:x1876035752721408:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789127235.187419:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7906cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+18:8472:x1876035752721408:12345-0@lo:502:llog_process_th.0 Request processed in 205us (1126us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127235.187438:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1789127235.187643:0:8472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79206cf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:8472:1876035752721408:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789127235.187670:0:8472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789127235.187678:0:8472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127235.187680:0:8472:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789127235.187685:0:8472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1789127235.187903:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:2.0:1789127235.187921:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789127235.187933:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df780031400/0xeeacf7c02430043b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c024300442 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127235.187945:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff8df780031400/0xeeacf7c02430043b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c024300442 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127235.187957:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1789127235.187960:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8df790d38000 from 1 10000000:01000000:2.0:1789127235.187963:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789127235.187994:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df79032ce00/0xeeacf7c024300449 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127235.188003:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff8df79032ce00/0xeeacf7c024300449 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127235.188023:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff8df79032ce00/0xeeacf7c024300449 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127235.188045:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79062c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752721536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789127235.188085:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127235.188113:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7833fac00 going to sleep for 11 seconds 00000100:00100000:0.0:1789127235.188253:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752721536 00000100:00100000:0.0:1789127235.188258:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752721536 00000100:00100000:0.0:1789127235.188297:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1789127235.188306:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7880ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+18:5827:x1876035752721536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789127235.188317:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127235.188347:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df7ae728800/0xeeacf7c024300450 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xeeacf7c024300449 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127235.188373:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df7ae728800/0xeeacf7c024300450 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xeeacf7c024300449 expref: 19 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127235.188393:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df7ae728800/0xeeacf7c024300450 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c024300449 expref: 19 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127235.188403:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7ae728800, rc 0) 00000100:00100000:0.0:1789127235.188450:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7880ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:5827:x1876035752721536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127235.188467:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1789127235.188503:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79062c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752721536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789127235.188516:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff8df79032ce00/0xeeacf7c024300449 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c024300450 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127235.188641:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff8df79032ce00/0xeeacf7c024300449 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xeeacf7c024300450 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127235.188693:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79062b840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752721664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789127235.188722:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127235.188738:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7984ccd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789127235.188752:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752721664 00000100:00100000:0.0:1789127235.188756:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752721664 00000100:00100000:0.0:1789127235.188779:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1789127235.188785:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7880ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:5827:x1876035752721664:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789127235.189112:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7880ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:5827:x1876035752721664:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 326us (389us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789127235.189120:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1789127235.189151:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79062b840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752721664:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1789127235.189172:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789127235.189178:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df79032ce00/0xeeacf7c024300449 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c024300450 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127235.189186:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff8df79032ce00/0xeeacf7c024300449 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c024300450 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127236.026612:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127236.083097:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79062b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1876035752721792:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789127236.083203:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127236.083555:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752721792 00000100:00100000:0.0:1789127236.083566:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752721792 00000100:00100000:0.0:1789127236.083646:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789127236.083657:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79062e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876035752721792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789127236.083716:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789127236.083770:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79062e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876035752721792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127236.083779:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1789127236.083956:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789127236.083995:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df79062b840 x1876035752721792/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127252 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127236.084015:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79062b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1876035752721792:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789127236.084369:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79062ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876035752722048:0@lo:400:kworker.0 00000100:00100000:3.0:1789127236.084952:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127236.085081:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df790628b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3301:1876035752721920:0@lo:400:kworker.0 00000100:00100000:1.0:1789127236.085135:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127236.085186:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752721920 00000100:00100000:1.0:1789127236.085191:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752721920 00000100:00100000:1.0:1789127236.085228:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1789127236.085234:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7880ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:3301:x1876035752721920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127236.085274:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7880ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:3301:x1876035752721920:12345-0@lo:400:kworker.0 Request processed in 40us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127236.085281:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1789127236.085320:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df790628b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3301:1876035752721920:0@lo:400:kworker.0 00000100:00100000:3.0:1789127236.087778:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789127236.087812:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79062b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1876035752722176:0@lo:400:kworker.0 00000100:00100000:3.0:1789127236.087883:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127236.087940:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752722048 00000100:00100000:3.0:1789127236.087948:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752722048 00000100:00100000:3.0:1789127236.088108:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752722176 00000100:00100000:3.0:1789127236.088112:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752722176 00000100:00100000:2.0:1789127236.088164:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789127236.088176:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79206cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876035752722048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127236.088238:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79206cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876035752722048:12345-0@lo:400:kworker.0 Request processed in 65us (3287us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127236.088245:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789127236.088264:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789127236.088270:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79206f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876035752722176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127236.092067:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79206f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876035752722176:12345-0@lo:400:kworker.0 Request processed in 3788us (4176us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127236.092083:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789127236.092127:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79062bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1876035752722304:0@lo:400:kworker.0 00000100:00100000:2.0:1789127236.092193:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127236.092240:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789127236.092246:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df790628f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1876035752722432:0@lo:400:kworker.0 00000100:00100000:2.0:1789127236.092272:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127236.092294:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752722432 00000100:00100000:2.0:1789127236.092301:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752722432 00000100:00100000:2.0:1789127236.092344:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789127236.092352:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79062cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876035752722432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127236.092416:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79062cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876035752722432:12345-0@lo:400:kworker.0 Request processed in 65us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127236.092640:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789127236.092683:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df790628f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1876035752722432:0@lo:400:kworker.0 00000100:00100000:0.0:1789127236.093585:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752722304 00000100:00100000:0.0:1789127236.093594:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752722304 00000100:00100000:0.0:1789127236.093649:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789127236.093658:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79062f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1876035752722304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127236.093729:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79062f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1876035752722304:12345-0@lo:400:kworker.0 Request processed in 72us (1536us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127236.093736:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1789127236.093878:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df79062bc00 x1876035752722304/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127252 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127236.093891:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79062bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1876035752722304:0@lo:400:kworker.0 00000100:00080000:2.0:1789127236.094083:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789127236.094089:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789127236.097315:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79062b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1876035752722176:0@lo:400:kworker.0 00000100:00100000:3.0:1789127236.097335:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79062ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876035752722048:0@lo:400:kworker.0 00000100:00100000:3.0:1789127236.331210:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127236.331255:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127236.331302:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127236.331343:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127236.331373:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733820672 00000100:00100000:3.0:1789127236.331382:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733820672 00000100:00100000:3.0:1789127236.331443:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 29 00000100:00100000:3.0:1789127236.331462:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79206f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+6:2346:x1876035733820672:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:3.0:1789127236.331533:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79206f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+6:2346:x1876035733820672:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 73us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127236.331541:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 29 00000100:00100000:3.0:1789127236.331564:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733820800 00000100:00100000:3.0:1789127236.331567:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733820800 00000100:00100000:3.0:1789127236.331590:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733820928 00000100:00100000:3.0:1789127236.331593:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733820928 00000100:00100000:3.0:1789127236.331628:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 11 00000100:00100000:3.0:1789127236.331635:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79206e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+5:2346:x1876035733820800:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:3.0:1789127236.331662:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79206e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+5:2346:x1876035733820800:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 27us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127236.331668:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 11 00000100:00100000:3.0:1789127236.331680:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 12 00000100:00100000:3.0:1789127236.331687:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79206fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+5:2346:x1876035733820928:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:3.0:1789127236.331725:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79206fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+5:2346:x1876035733820928:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 38us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127236.331731:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 12 00000100:00080000:3.0:1789127236.331747:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789127236.331750:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789127236.331753:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789127236.331969:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733820544 00000100:00100000:0.0:1789127236.331974:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733820544 00000100:00100000:0.0:1789127236.332005:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 172 00000100:00100000:0.0:1789127236.332012:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7880ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d829a69b-d740-4e4c-8301-ef09c9d45165+10:2346:x1876035733820544:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:0.0:1789127236.340458:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7880ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d829a69b-d740-4e4c-8301-ef09c9d45165+10:2346:x1876035733820544:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 8425us (9236us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127236.340475:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 172 00000020:00000080:0.0:1789127236.445214:0:8509:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe1af62560 20000000:00000080:0.0:1789127236.445234:0:8509:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8df7b4303000 uarg=0000000000000000 20000000:01000000:0.0:1789127236.445274:0:8509:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789127236.445280:0:8509:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789127236.445284:0:8509:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1789127236.452627:0:8510:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1789127236.452898:0:8509:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1789127236.458922:0:8509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1789127236.458976:0:8509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1789127236.459032:0:8509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1789127236.459059:0:8509:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789127236.459078:0:8509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8df7ae728c00/0xeeacf7c024300457 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127236.459096:0:8509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df7c2173400/0xeeacf7c0243001cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c0243001c5 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127236.459106:0:8509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df798df1c00/0xeeacf7c02430022e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c024300227 expref: 18 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127236.459113:0:8509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df7c2173200/0xeeacf7c0243002f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c0243002f2 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127236.459121:0:8509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df780030600/0xeeacf7c0243003b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b79c2 expref: 9 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127236.459128:0:8509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8df7ae728c00/0xeeacf7c024300457 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127236.459783:0:8509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df780030600/0xeeacf7c0243003b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b79c2 expref: 9 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127236.459822:0:8509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df780030600/0xeeacf7c0243003b6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b79c2 expref: 9 pid: 5824 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127236.459836:0:8509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7bfc49a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8509:1876035752722560:192.168.206.40@tcp:104: 00010000:00010000:1.0:1789127236.459962:0:8509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df7c2173200/0xeeacf7c0243002f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xeeacf7c0243002f2 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127236.459971:0:8509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df7c2173200/0xeeacf7c0243002f9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xeeacf7c0243002f2 expref: 18 pid: 5824 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127236.459980:0:8509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7bfc4b0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8509:1876035752722688:0@lo:104: 00000100:00100000:1.0:1789127236.460018:0:8509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127236.460064:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752722688 00010000:00010000:1.0:1789127236.460064:0:8509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df798df1c00/0xeeacf7c02430022e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xeeacf7c024300227 expref: 18 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127236.460070:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752722688 00010000:00010000:1.0:1789127236.460072:0:8509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df798df1c00/0xeeacf7c02430022e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xeeacf7c024300227 expref: 18 pid: 5822 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127236.460091:0:8509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7bfc4b840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8509:1876035752722816:0@lo:104: 00000100:00100000:3.0:1789127236.460129:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789127236.460129:0:8509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127236.460138:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bfc49680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+3:8509:x1876035752722688:12345-0@lo:104: 00010000:00010000:1.0:1789127236.460150:0:8509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df7c2173400/0xeeacf7c0243001cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xeeacf7c0243001c5 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127236.460152:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.140@tcp lock: ffff8df7c2172a00/0xeeacf7c0243002f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xeeacf7c0243002f9 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127236.460159:0:8509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df7c2173400/0xeeacf7c0243001cc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xeeacf7c0243001c5 expref: 18 pid: 5824 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127236.460166:0:8509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7bfc4a940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8509:1876035752722944:0@lo:104: 00000100:00100000:1.0:1789127236.460183:0:8509:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df6825b8480 going to sleep for 11 seconds 00010000:00010000:3.0:1789127236.460196:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789127236.460201:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bfc49680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+3:8509:x1876035752722688:12345-0@lo:104: Request processed in 66us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127236.460209:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789127236.460212:0:8509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7bfc4b0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8509:1876035752722688:0@lo:104: 00000100:00100000:3.0:1789127236.460230:0:5813:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789127236.460246:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127236.460255:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752722816 00000100:00100000:3.0:1789127236.460258:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752722816 00000100:00100000:3.0:1789127236.460271:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752722944 00000100:00100000:3.0:1789127236.460273:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752722944 00000100:00100000:3.0:1789127236.460284:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789127236.460365:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bbd9a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+4:8509:x1876035752722816:12345-0@lo:104: 00010000:00010000:3.0:1789127236.460375:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.140@tcp lock: ffff8df7c2173e00/0xeeacf7c024300227 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xeeacf7c02430022e expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127236.460596:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789127236.460603:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.140@tcp lock: ffff8df7c2172a00/0xeeacf7c0243002f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xeeacf7c0243002f9 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127236.460611:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7c2172a00 already unused, calling callback (ffffffffc1da1c20) 00010000:00010000:3.0:1789127236.460616:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 10000000:00010000:2.0:1789127236.460616:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.140@tcp lock: ffff8df7c2172a00/0xeeacf7c0243002f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xeeacf7c0243002f9 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127236.460622:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bbd9a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+4:8509:x1876035752722816:12345-0@lo:104: Request processed in 332us (501us total) trans 0 rc 0/0 00010000:00010000:2.0:1789127236.460624:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: ffff8df7c2172a00/0xeeacf7c0243002f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xeeacf7c0243002f9 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127236.460629:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 10000000:00010000:2.0:1789127236.460632:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: ffff8df7c2172a00/0xeeacf7c0243002f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xeeacf7c0243002f9 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127236.460638:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789127236.460664:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.140@tcp lock: ffff8df7c2172a00/0xeeacf7c0243002f2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c0243002f9 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127236.460665:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1789127236.460670:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789127236.460671:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79206ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+3:8509:x1876035752722944:12345-0@lo:104: 00010000:00010000:3.0:1789127236.460678:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.140@tcp lock: ffff8df7c2050c00/0xeeacf7c0243001c5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xeeacf7c0243001cc expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127236.460690:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.140@tcp lock: ffff8df7c2172a00/0xeeacf7c0243002f2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c0243002f9 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127236.460703:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789127236.460708:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79206ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+3:8509:x1876035752722944:12345-0@lo:104: Request processed in 38us (461us total) trans 0 rc 0/0 00010000:00010000:2.0:1789127236.460708:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: ffff8df7c2172a00/0xeeacf7c0243002f2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c0243002f9 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127236.460714:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1789127236.460722:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789127236.460725:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.140@tcp lock: ffff8df7c2173e00/0xeeacf7c024300227 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xeeacf7c02430022e expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127236.460728:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789127236.460731:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7c2173e00 already unused, calling callback (ffffffffc1da1c20) 10000000:00010000:2.0:1789127236.460734:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.140@tcp lock: ffff8df7c2173e00/0xeeacf7c024300227 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xeeacf7c02430022e expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127236.460741:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: ffff8df7c2173e00/0xeeacf7c024300227 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xeeacf7c02430022e expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127236.460747:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79062ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3302:1876035752723072:0@lo:103:ldlm_bl.0 10000000:00010000:2.0:1789127236.460747:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: ffff8df7c2173e00/0xeeacf7c024300227 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xeeacf7c02430022e expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127236.460752:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789127236.460765:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.140@tcp lock: ffff8df7c2173e00/0xeeacf7c024300227 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c02430022e expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127236.460771:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789127236.460771:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789127236.460777:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.140@tcp lock: ffff8df7c2173e00/0xeeacf7c024300227 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c02430022e expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127236.460783:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: ffff8df7c2173e00/0xeeacf7c024300227 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c02430022e expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127236.460817:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127236.460824:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:2.0:1789127236.460824:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127236.460826:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127236.460831:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79062f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3302:1876035752723200:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789127236.460839:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752723072 00000100:00100000:2.0:1789127236.460843:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752723072 00000100:00100000:3.0:1789127236.460852:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789127236.460861:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df7c2173200/0xeeacf7c0243002f9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xeeacf7c0243002f2 expref: 19 pid: 5824 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127236.460879:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752723200 00000100:00100000:2.0:1789127236.460881:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752723200 00010000:00010000:2.0:1789127236.460892:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df798df1c00/0xeeacf7c02430022e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xeeacf7c024300227 expref: 20 pid: 5822 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127236.460909:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789127236.460915:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79206cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+20:3302:x1876035752723072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789127236.460923:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789127236.460927:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df7c2173200/0xeeacf7c0243002f9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xeeacf7c0243002f2 expref: 20 pid: 5824 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127236.460934:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df7c2173200/0xeeacf7c0243002f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xeeacf7c0243002f2 expref: 20 pid: 5824 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127236.460947:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df7c2173200/0xeeacf7c0243002f9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xeeacf7c0243002f2 expref: 20 pid: 5824 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127236.460950:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789127236.460957:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79206de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:3302:x1876035752723200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789127236.460959:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789127236.460964:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127236.460967:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df798df1c00/0xeeacf7c02430022e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xeeacf7c024300227 expref: 19 pid: 5822 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127236.460976:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df798df1c00/0xeeacf7c02430022e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xeeacf7c024300227 expref: 19 pid: 5822 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127236.460986:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79206cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:3302:x1876035752723072:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (214us total) trans 0 rc 0/0 00010000:00010000:3.0:1789127236.460991:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789127236.460992:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789127236.461011:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79206de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+18:3302:x1876035752723200:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127236.461017:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789127236.461055:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79062f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3302:1876035752723200:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789127236.461063:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79062ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3302:1876035752723072:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789127236.461339:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127236.461342:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127236.461344:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127236.461471:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.140@tcp lock: ffff8df7c2050c00/0xeeacf7c0243001c5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xeeacf7c0243001cc expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127236.461481:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7c2050c00 already unused, calling callback (ffffffffc1da1c20) 10000000:00010000:3.0:1789127236.461484:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.140@tcp lock: ffff8df7c2050c00/0xeeacf7c0243001c5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xeeacf7c0243001cc expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127236.461492:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: ffff8df7c2050c00/0xeeacf7c0243001c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xeeacf7c0243001cc expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789127236.461497:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: ffff8df7c2050c00/0xeeacf7c0243001c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xeeacf7c0243001cc expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127236.461502:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789127236.461529:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.140@tcp lock: ffff8df7c2050c00/0xeeacf7c0243001c5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c0243001cc expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127236.461536:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789127236.461562:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.140@tcp lock: ffff8df7c2050c00/0xeeacf7c0243001c5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c0243001cc expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127236.461568:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: ffff8df7c2050c00/0xeeacf7c0243001c5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c0243001cc expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127236.461588:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127236.461590:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127236.461591:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127236.461598:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789127236.461619:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7af7cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3301:1876035752723328:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789127236.461649:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127236.461675:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752723328 00000100:00100000:3.0:1789127236.461679:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752723328 00010000:00010000:3.0:1789127236.461694:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df7c2173400/0xeeacf7c0243001cc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xeeacf7c0243001c5 expref: 18 pid: 5824 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127236.461715:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789127236.461722:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79a2c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+18:3301:x1876035752723328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789127236.461731:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127236.461735:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df7c2173400/0xeeacf7c0243001cc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xeeacf7c0243001c5 expref: 18 pid: 5824 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127236.461743:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df7c2173400/0xeeacf7c0243001cc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xeeacf7c0243001c5 expref: 18 pid: 5824 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127236.461755:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789127236.461820:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7af7cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3301:1876035752723328:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789127236.461979:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79a2c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+18:3301:x1876035752723328:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127236.461988:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:1.0:1789127236.462170:0:8509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df798df1c00/0xeeacf7c02430022e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xeeacf7c024300227 expref: 17 pid: 5822 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127236.462181:0:8509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7bfc4b840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8509:1876035752722816:0@lo:104: 00010000:00010000:1.0:1789127236.462203:0:8509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df7c2173400/0xeeacf7c0243001cc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xeeacf7c0243001c5 expref: 16 pid: 5824 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127236.462212:0:8509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7bfc4a940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8509:1876035752722944:0@lo:104: 00000100:00100000:1.0:1789127236.464645:0:8509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7bfc49a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8509:1876035752722560:192.168.206.40@tcp:104: 00010000:00010000:1.0:1789127236.464677:0:8509:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8df7ae728c00/0xeeacf7c024300457 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127236.466217:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127236.466279:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733821056 00000100:00100000:0.0:1789127236.466287:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733821056 00010000:00010000:0.0:1789127236.466332:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df780030600/0xeeacf7c0243003b6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b79c2 expref: 10 pid: 5824 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127236.466370:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 24 00000100:00100000:0.0:1789127236.466379:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79a2c52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d829a69b-d740-4e4c-8301-ef09c9d45165+10:2349:x1876035733821056:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789127236.466393:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789127236.466400:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df780030600/0xeeacf7c0243003b6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b79c2 expref: 10 pid: 5824 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127236.466412:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df780030600/0xeeacf7c0243003b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b79c2 expref: 10 pid: 5824 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127236.466443:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df780030600/0xeeacf7c0243003b6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b79c2 expref: 10 pid: 5824 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127236.466472:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8df7ae728c00/0xeeacf7c024300457 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127236.466481:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df7ae728c00/0xeeacf7c024300457 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127236.466496:0:5815:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df7ae728c00/0xeeacf7c024300457 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127236.466503:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df7ae728c00/0xeeacf7c024300457 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127236.466510:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8df7ae728c00/0xeeacf7c024300457 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127236.466517:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8df7ae728c00/0xeeacf7c024300457 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127236.466523:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7ae728c00 already unused, calling callback (ffffffffc17a4550) 00010000:00010000:0.0:1789127236.466527:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8df7ae728c00/0xeeacf7c024300457 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127236.466535:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8df7ae728c00/0xeeacf7c024300457 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127236.466556:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8df7ae728c00/0xeeacf7c024300457 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127236.466577:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789127236.466750:0:8509:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8df7ae728c00/0xeeacf7c024300457 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127236.466759:0:8509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8df7ae728c00/0xeeacf7c024300457 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127236.466772:0:8509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df7ae728c00/0xeeacf7c024300457 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127236.467680:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79a2c52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d829a69b-d740-4e4c-8301-ef09c9d45165+9:2349:x1876035733821056:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 1296us (1464us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127236.467690:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 24 00000100:00100000:2.0:1789127236.573638:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127236.578989:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733821184 00000100:00100000:0.0:1789127236.579003:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733821184 00000100:00100000:0.0:1789127236.579062:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 173 00000100:00100000:0.0:1789127236.579071:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7880aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d829a69b-d740-4e4c-8301-ef09c9d45165+9:5590:x1876035733821184:12345-192.168.206.40@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789127236.579088:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127236.579106:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df7ae728600/0xeeacf7c02430045e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7a01 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127236.579134:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df7ae728600/0xeeacf7c02430045e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7a01 expref: 10 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127236.579144:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df7ae728600/0xeeacf7c02430045e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7a01 expref: 10 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127236.579153:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7ae728600, rc 0) 00000100:00100000:0.0:1789127236.579808:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7880aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d829a69b-d740-4e4c-8301-ef09c9d45165+10:5590:x1876035733821184:12345-192.168.206.40@tcp:101:ll_cfg_requeue.0 Request processed in 713us (6153us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127236.579818:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 173 00000100:00100000:3.0:1789127236.595353:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127236.595385:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733821312 00000100:00100000:3.0:1789127236.595406:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733821312 00000100:00100000:3.0:1789127236.595467:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 174 00000100:00100000:3.0:1789127236.595477:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7880ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d829a69b-d740-4e4c-8301-ef09c9d45165+10:5590:x1876035733821312:12345-192.168.206.40@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789127236.595749:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7880ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d829a69b-d740-4e4c-8301-ef09c9d45165+10:5590:x1876035733821312:12345-192.168.206.40@tcp:501:ll_cfg_requeue.0 Request processed in 272us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127236.595758:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 174 00000100:00100000:3.0:1789127236.610858:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127236.611033:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733821440 00000100:00100000:0.0:1789127236.611042:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733821440 00000100:00100000:0.0:1789127236.611100:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 175 00000100:00100000:0.0:1789127236.611111:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7880adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d829a69b-d740-4e4c-8301-ef09c9d45165+10:5590:x1876035733821440:12345-192.168.206.40@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789127236.611316:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7880adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d829a69b-d740-4e4c-8301-ef09c9d45165+10:5590:x1876035733821440:12345-192.168.206.40@tcp:503:ll_cfg_requeue.0 Request processed in 207us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127236.611325:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 175 00000100:00100000:3.0:1789127236.641301:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127236.641393:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733821568 00000100:00100000:1.0:1789127236.641402:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733821568 00000100:00100000:1.0:1789127236.641467:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 176 00000100:00100000:1.0:1789127236.641476:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7880ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d829a69b-d740-4e4c-8301-ef09c9d45165+10:6088:x1876035733821568:12345-192.168.206.40@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789127236.641691:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7880ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d829a69b-d740-4e4c-8301-ef09c9d45165+10:6088:x1876035733821568:12345-192.168.206.40@tcp:502:llog_process_th.0 Request processed in 214us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127236.641711:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 176 00000100:00100000:0.0:1789127236.648251:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127236.648386:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733821696 00000100:00100000:3.0:1789127236.648394:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733821696 00000100:00100000:3.0:1789127236.648461:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 177 00000100:00100000:3.0:1789127236.648471:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7880acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d829a69b-d740-4e4c-8301-ef09c9d45165+10:6088:x1876035733821696:12345-192.168.206.40@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789127236.649823:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7880acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d829a69b-d740-4e4c-8301-ef09c9d45165+10:6088:x1876035733821696:12345-192.168.206.40@tcp:502:llog_process_th.0 Request processed in 1345us (1573us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127236.649835:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 177 00010000:00010000:3.0:1789127237.044104:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127237.106994:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789127237.107016:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7bfc49a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1876035752723456:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789127237.107082:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127237.107495:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752723456 00000100:00100000:0.0:1789127237.107503:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752723456 00000100:00100000:0.0:1789127237.107553:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789127237.107563:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79a2c61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876035752723456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789127237.107593:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789127237.107653:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79a2c61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876035752723456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127237.107660:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1789127237.107901:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df7bfc49a40 x1876035752723456/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127253 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127237.107919:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7bfc49a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1876035752723456:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789127238.067011:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789127238.262220:0:5827:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789127238.262228:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df7b45fe800 from 4 10000000:01000000:3.0:1789127238.262232:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789127238.262273:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df798df0800/0xeeacf7c024300465 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127238.262285:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff8df798df0800/0xeeacf7c024300465 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127238.262295:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff8df798df0800/0xeeacf7c024300465 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127238.262331:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae9192c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752723584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789127238.262392:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127238.262455:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7ae298480 going to sleep for 11 seconds 00000100:00100000:3.0:1789127238.262478:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752723584 00000100:00100000:3.0:1789127238.262553:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752723584 00000100:00100000:3.0:1789127238.262603:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1789127238.262612:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7880afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+16:5827:x1876035752723584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789127238.262624:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127238.262637:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df798df1c00/0xeeacf7c02430046c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xeeacf7c024300465 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127238.263570:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df798df1c00/0xeeacf7c02430046c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xeeacf7c024300465 expref: 17 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127238.263583:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df798df1c00/0xeeacf7c02430046c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c024300465 expref: 17 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127238.263593:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df798df1c00, rc 0) 00000100:00100000:3.0:1789127238.264225:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7880afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+17:5827:x1876035752723584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1611us (1829us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127238.264235:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1789127238.264301:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae9192c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752723584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789127238.264319:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff8df798df0800/0xeeacf7c024300465 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c02430046c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127238.264330:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff8df798df0800/0xeeacf7c024300465 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xeeacf7c02430046c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127238.265741:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae9192c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752723712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789127238.265817:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127238.265843:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7ae298480 going to sleep for 11 seconds 00000100:00100000:3.0:1789127238.265868:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752723712 00000100:00100000:3.0:1789127238.265873:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752723712 00000100:00100000:3.0:1789127238.265912:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1789127238.265920:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7880ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+17:5827:x1876035752723712:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789127238.267908:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7880ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+17:5827:x1876035752723712:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1983us (2085us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127238.267921:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1789127238.268596:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae9192c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752723712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789127238.269226:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79062a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752723840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789127238.269288:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127238.269324:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7988fb180 going to sleep for 11 seconds 00000100:00100000:3.0:1789127238.269371:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752723840 00000100:00100000:3.0:1789127238.269377:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752723840 00000100:00100000:3.0:1789127238.269431:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1789127238.269451:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7880af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+17:5827:x1876035752723840:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789127238.271320:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7880af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+17:5827:x1876035752723840:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1875us (2026us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127238.271334:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1789127238.271402:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79062a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752723840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789127238.273447:0:8585:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae919e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:8585:1876035752723968:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789127238.275902:0:8585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127238.275950:0:8585:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7ae298480 going to sleep for 11 seconds 00000100:00100000:2.0:1789127238.276238:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752723968 00000100:00100000:2.0:1789127238.276246:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752723968 00000100:00100000:2.0:1789127238.276298:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1789127238.276308:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7880ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+17:8585:x1876035752723968:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789127238.278248:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7880ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+17:8585:x1876035752723968:12345-0@lo:502:llog_process_th.0 Request processed in 1935us (2344us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127238.278260:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1789127238.279117:0:8585:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae919e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:8585:1876035752723968:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789127238.279230:0:8585:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789127238.279248:0:8585:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127238.279250:0:8585:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789127238.279257:0:8585:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8df7b45fe800 00000020:00000080:3.0:1789127238.279259:0:8585:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789127238.284280:0:8585:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79062fc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:8585:1876035752724096:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789127238.284365:0:8585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127238.284405:0:8585:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7aea33cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789127238.286447:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752724096 00000100:00100000:2.0:1789127238.286458:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752724096 00000100:00100000:2.0:1789127238.286591:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1789127238.286602:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7880af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+17:8585:x1876035752724096:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789127238.287939:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7880af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+17:8585:x1876035752724096:12345-0@lo:502:llog_process_th.0 Request processed in 1327us (3562us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127238.287952:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1789127238.288614:0:8585:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79062fc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:8585:1876035752724096:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789127238.288657:0:8585:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789127238.288666:0:8585:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127238.288669:0:8585:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1789127238.288674:0:8585:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1789127238.291316:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1789127238.291350:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789127238.291361:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df798df0800/0xeeacf7c024300465 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c02430046c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127238.291374:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff8df798df0800/0xeeacf7c024300465 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c02430046c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127238.291385:0:5827:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789127238.291389:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df788896800 from 4 10000000:01000000:3.0:1789127238.291391:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789127238.291435:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df798df0200/0xeeacf7c024300473 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127238.291452:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff8df798df0200/0xeeacf7c024300473 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127238.291462:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff8df798df0200/0xeeacf7c024300473 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127238.291495:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae919e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752724224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789127238.291553:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127238.291595:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7ae298480 going to sleep for 11 seconds 00000100:00100000:3.0:1789127238.291617:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752724224 00000100:00100000:3.0:1789127238.291623:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752724224 00000100:00100000:3.0:1789127238.291675:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1789127238.291685:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7880ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+17:5827:x1876035752724224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789127238.291705:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127238.291717:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df798df1e00/0xeeacf7c02430047a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xeeacf7c024300473 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127238.291738:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df798df1e00/0xeeacf7c02430047a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xeeacf7c024300473 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127238.291748:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df798df1e00/0xeeacf7c02430047a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c024300473 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127238.291757:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df798df1e00, rc 0) 00000100:00100000:3.0:1789127238.291817:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7880ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+18:5827:x1876035752724224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127238.291824:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1789127238.291869:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae919e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752724224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789127238.294281:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff8df798df0200/0xeeacf7c024300473 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c02430047a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127238.294294:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff8df798df0200/0xeeacf7c024300473 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xeeacf7c02430047a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127238.294369:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae919e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752724352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789127238.294748:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127238.294858:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7ae298480 going to sleep for 11 seconds 00000100:00100000:2.0:1789127238.301420:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752724352 00000100:00100000:2.0:1789127238.301434:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752724352 00000100:00100000:2.0:1789127238.301862:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1789127238.301872:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7880af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+18:5827:x1876035752724352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789127238.302178:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7880af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+18:5827:x1876035752724352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 306us (7429us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127238.302197:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1789127238.302239:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae919e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752724352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789127238.302284:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79062cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752724480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789127238.302327:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127238.302355:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7aea33900 going to sleep for 11 seconds 00000100:00100000:2.0:1789127238.302369:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752724480 00000100:00100000:2.0:1789127238.302373:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752724480 00000100:00100000:2.0:1789127238.302392:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1789127238.302398:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df786b43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+18:5827:x1876035752724480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789127238.302564:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df786b43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+18:5827:x1876035752724480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 165us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127238.302572:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1789127238.302612:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79062cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752724480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789127238.311205:0:8589:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7bfc49a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:8589:1876035752724608:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789127238.311298:0:8589:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127238.311343:0:8589:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7833fab40 going to sleep for 11 seconds 00000100:00100000:2.0:1789127238.316755:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752724608 00000100:00100000:2.0:1789127238.316770:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752724608 00000100:00100000:2.0:1789127238.316889:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1789127238.316899:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df786b40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+18:8589:x1876035752724608:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789127238.317456:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df786b40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+18:8589:x1876035752724608:12345-0@lo:502:llog_process_th.0 Request processed in 556us (6155us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127238.317465:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1789127238.324405:0:8589:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7bfc49a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:8589:1876035752724608:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789127238.324468:0:8589:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789127238.324480:0:8589:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127238.324501:0:8589:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789127238.324509:0:8589:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8df788896800 00000020:00000080:1.0:1789127238.324512:0:8589:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789127238.324597:0:8589:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7bfc49a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:8589:1876035752724736:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789127238.324677:0:8589:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127238.324715:0:8589:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7833fab40 going to sleep for 11 seconds 00000100:00100000:1.0:1789127238.331312:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752724736 00000100:00100000:1.0:1789127238.331324:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752724736 00000100:00100000:1.0:1789127238.331377:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1789127238.331387:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df786b43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+18:8589:x1876035752724736:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789127238.333739:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df786b43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+18:8589:x1876035752724736:12345-0@lo:502:llog_process_th.0 Request processed in 2346us (9055us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127238.333753:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1789127238.333841:0:8589:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7bfc49a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:8589:1876035752724736:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789127238.333874:0:8589:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789127238.333883:0:8589:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127238.333886:0:8589:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1789127238.333891:0:8589:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1789127238.334081:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1789127238.334102:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789127238.334112:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df798df0200/0xeeacf7c024300473 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c02430047a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127238.334730:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff8df798df0200/0xeeacf7c024300473 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c02430047a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127238.334741:0:5827:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789127238.334744:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df788820800 from 4 10000000:01000000:2.0:1789127238.334747:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789127238.334779:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df79032d200/0xeeacf7c024300481 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127238.334812:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff8df79032d200/0xeeacf7c024300481 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127238.334822:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff8df79032d200/0xeeacf7c024300481 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127238.334844:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79062cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752724864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789127238.334895:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127238.335562:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7aea33cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789127238.335598:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752724864 00000100:00100000:2.0:1789127238.335605:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752724864 00000100:00100000:2.0:1789127238.335886:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1789127238.335896:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7902d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+18:5827:x1876035752724864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789127238.335910:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127238.335923:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df79032de00/0xeeacf7c024300488 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xeeacf7c024300481 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127238.335958:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df79032de00/0xeeacf7c024300488 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xeeacf7c024300481 expref: 19 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127238.335989:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df79032de00/0xeeacf7c024300488 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c024300481 expref: 19 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127238.335998:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df79032de00, rc 0) 00000100:00100000:2.0:1789127238.336052:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7902d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:5827:x1876035752724864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 157us (1156us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127238.336059:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1789127238.336098:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79062cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752724864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789127238.336114:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff8df79032d200/0xeeacf7c024300481 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c024300488 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127238.336134:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff8df79032d200/0xeeacf7c024300481 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xeeacf7c024300488 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127238.336188:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79062cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752724992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789127238.336217:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127238.336250:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7aea33cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789127238.336266:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752724992 00000100:00100000:2.0:1789127238.336270:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752724992 00000100:00100000:2.0:1789127238.336287:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1789127238.336292:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7902da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:5827:x1876035752724992:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789127238.336543:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7902da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:5827:x1876035752724992:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 250us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127238.336550:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1789127238.336574:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79062cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752724992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789127238.336610:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79062cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752725120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789127238.336658:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127238.336668:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7aea33cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789127238.336685:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752725120 00000100:00100000:2.0:1789127238.336689:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752725120 00000100:00100000:2.0:1789127238.336708:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1789127238.336714:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df790dc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:5827:x1876035752725120:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789127238.336868:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df790dc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:5827:x1876035752725120:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 154us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127238.336876:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1789127238.336905:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79062cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752725120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789127238.339665:0:8593:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79062a1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:8593:1876035752725248:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789127238.339736:0:8593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127238.339770:0:8593:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7a0334540 going to sleep for 11 seconds 00000100:00100000:0.0:1789127238.339802:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752725248 00000100:00100000:0.0:1789127238.339808:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752725248 00000100:00100000:0.0:1789127238.339846:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1789127238.339854:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df790dc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:8593:x1876035752725248:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789127238.340045:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df790dc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:8593:x1876035752725248:12345-0@lo:502:llog_process_th.0 Request processed in 190us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127238.340063:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1789127238.340110:0:8593:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79062a1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:8593:1876035752725248:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789127238.340148:0:8593:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789127238.340157:0:8593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127238.340160:0:8593:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789127238.340167:0:8593:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8df788820800 00000020:00000080:0.0:1789127238.340169:0:8593:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789127238.340468:0:8593:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79062a1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:8593:1876035752725376:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789127238.340504:0:8593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127238.340525:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752725376 00000100:00100000:0.0:1789127238.340529:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752725376 00000100:00100000:0.0:1789127238.340552:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1789127238.340558:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df787bb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:8593:x1876035752725376:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789127238.340673:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df787bb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:8593:x1876035752725376:12345-0@lo:502:llog_process_th.0 Request processed in 115us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127238.340680:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1789127238.340715:0:8593:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7a0334540 going to sleep for 11 seconds 00000100:00100000:0.0:1789127238.340726:0:8593:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79062a1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:8593:1876035752725376:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789127238.340742:0:8593:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789127238.340747:0:8593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127238.340749:0:8593:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1789127238.340753:0:8593:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1789127238.340818:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1789127238.340834:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789127238.340843:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df79032d200/0xeeacf7c024300481 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c024300488 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127238.340864:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff8df79032d200/0xeeacf7c024300481 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c024300488 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127239.091196:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127240.115097:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127241.139750:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127241.204508:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789127241.204530:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79062a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1876035752725504:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789127241.204598:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127241.204661:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752725504 00000100:00100000:0.0:1789127241.204669:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752725504 00000100:00100000:0.0:1789127241.204723:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789127241.204732:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79062ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876035752725504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789127241.204768:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789127241.204838:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79062ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876035752725504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127241.204844:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1789127241.204883:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df79062a1c0 x1876035752725504/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127257 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127241.204900:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79062a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1876035752725504:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1789127241.206201:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789127241.206217:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae918000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876035752725760:0@lo:400:kworker.0 00000100:00100000:3.0:1789127241.206281:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127241.206329:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789127241.206335:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae9183c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1876035752725888:0@lo:400:kworker.0 00000100:00100000:3.0:1789127241.206360:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127241.206533:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae91a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752726016:0@lo:400:kworker.0 00000100:00100000:1.0:1789127241.206566:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127241.206589:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789127241.206594:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae919a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3302:1876035752725632:0@lo:400:kworker.0 00000100:00100000:1.0:1789127241.206618:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127241.206641:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae919680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1876035752726144:0@lo:400:kworker.0 00000100:00100000:1.0:1789127241.206662:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127241.206858:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752725760 00000100:00100000:3.0:1789127241.206864:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752725760 00000100:00100000:3.0:1789127241.206899:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752725888 00000100:00100000:3.0:1789127241.206902:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752725888 00000100:00100000:3.0:1789127241.206926:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752726144 00000100:00100000:3.0:1789127241.207051:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752726144 00000100:00100000:3.0:1789127241.207075:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789127241.207082:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae918780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876035752725760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127241.207130:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae918780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876035752725760:12345-0@lo:400:kworker.0 Request processed in 47us (861us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127241.207136:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789127241.207150:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789127241.207156:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae91a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876035752725888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127241.207183:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae91a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876035752725888:12345-0@lo:400:kworker.0 Request processed in 27us (822us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127241.207188:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789127241.207199:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789127241.207204:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bfc4b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876035752726144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127241.207236:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bfc4b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876035752726144:12345-0@lo:400:kworker.0 Request processed in 32us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127241.207242:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789127241.207264:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752726016 00000100:00080000:1.0:1789127241.208200:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789127241.208476:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752726016 00000100:00100000:3.0:1789127241.208542:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789127241.208552:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bfc4a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1876035752726016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127241.208619:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bfc4a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1876035752726016:12345-0@lo:400:kworker.0 Request processed in 69us (2051us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127241.208625:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789127241.208676:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae919680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1876035752726144:0@lo:400:kworker.0 00010000:00080000:3.0:1789127241.208689:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df7ae91a940 x1876035752726016/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127257 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127241.208699:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae91a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752726016:0@lo:400:kworker.0 00000100:00100000:3.0:1789127241.208732:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae9183c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1876035752725888:0@lo:400:kworker.0 00000100:00100000:3.0:1789127241.208743:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae918000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876035752725760:0@lo:400:kworker.0 00000100:00100000:0.0:1789127241.209119:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752725632 00000100:00100000:0.0:1789127241.209126:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752725632 00000100:00100000:0.0:1789127241.209159:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1789127241.209166:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df787bbb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:3302:x1876035752725632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127241.209208:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df787bbb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:3302:x1876035752725632:12345-0@lo:400:kworker.0 Request processed in 43us (2589us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127241.209215:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00080000:1.0:1789127241.209506:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789127241.210251:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae919a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3302:1876035752725632:0@lo:400:kworker.0 00000100:00100000:3.0:1789127241.456478:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127241.456516:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127241.456541:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127241.456576:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127241.456603:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733821824 00000100:00100000:3.0:1789127241.456611:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733821824 00000100:00100000:3.0:1789127241.456972:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 194 00000100:00100000:3.0:1789127241.456983:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df787bb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d829a69b-d740-4e4c-8301-ef09c9d45165+10:2346:x1876035733821824:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:3.0:1789127241.457049:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df787bb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d829a69b-d740-4e4c-8301-ef09c9d45165+10:2346:x1876035733821824:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 68us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127241.457057:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 194 00000100:00100000:3.0:1789127241.457092:0:8063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733822080 00000100:00100000:3.0:1789127241.457096:0:8063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733822080 00000100:00100000:3.0:1789127241.457143:0:8063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733822208 00000100:00100000:3.0:1789127241.457146:0:8063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733822208 00000100:00100000:3.0:1789127241.457166:0:8063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 14 00000100:00100000:3.0:1789127241.457173:0:8063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae919a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+5:2346:x1876035733822080:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:3.0:1789127241.457202:0:8063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae919a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+5:2346:x1876035733822080:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 30us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127241.457209:0:8063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 14 00000100:00100000:3.0:1789127241.457219:0:8063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 15 00000100:00100000:3.0:1789127241.457225:0:8063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae9183c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+5:2347:x1876035733822208:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:3.0:1789127241.457247:0:8063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae9183c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+5:2347:x1876035733822208:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 23us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127241.457252:0:8063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 15 00000100:00100000:3.0:1789127241.457340:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733821952 00000100:00100000:3.0:1789127241.457345:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733821952 00000100:00100000:3.0:1789127241.457375:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 33 00000100:00100000:3.0:1789127241.457381:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae918000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+6:2347:x1876035733821952:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:3.0:1789127241.457412:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae918000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+6:2347:x1876035733821952:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 31us (869us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127241.457418:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 33 00000100:00080000:3.0:1789127241.457543:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789127241.457548:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789127241.457550:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789127242.175833:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127242.230730:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789127242.230753:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79062a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1876035752726272:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789127242.230884:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127242.230959:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752726272 00000100:00100000:0.0:1789127242.230966:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752726272 00000100:00100000:0.0:1789127242.231007:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789127242.231015:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79062b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876035752726272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789127242.231050:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789127242.231091:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79062b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876035752726272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127242.231098:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1789127242.231134:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df79062a1c0 x1876035752726272/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127258 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127242.231152:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79062a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1876035752726272:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789127243.187319:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789127243.753936:0:8810:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg640-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:2.0:1789127244.211946:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127245.242914:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127246.264670:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127246.323220:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae91ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1876035752726784:0@lo:400:kworker.0 00000100:00100000:1.0:1789127246.323220:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae919680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3301:1876035752726400:0@lo:400:kworker.0 00000100:00100000:0.0:1789127246.323375:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae918b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1876035752726656:0@lo:400:kworker.0 00000100:00100000:3.0:1789127246.330037:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127246.330126:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae91b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876035752726528:0@lo:400:kworker.0 00000100:00100000:3.0:1789127246.330170:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127246.330188:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae91bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752727040:0@lo:400:kworker.0 00000100:00100000:3.0:1789127246.330215:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127246.330252:0:8063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752726784 00000100:00100000:3.0:1789127246.330258:0:8063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752726784 00000100:00100000:3.0:1789127246.330304:0:8063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752727040 00000100:00100000:3.0:1789127246.330307:0:8063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752727040 00000100:00100000:3.0:1789127246.330329:0:8063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789127246.330336:0:8063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae918f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1876035752726784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127246.330411:0:8063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae918f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1876035752726784:12345-0@lo:400:kworker.0 Request processed in 75us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127246.330418:0:8063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789127246.330433:0:8063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789127246.330440:0:8063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae91a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1876035752727040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127246.330472:0:8063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae91a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1876035752727040:12345-0@lo:400:kworker.0 Request processed in 33us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127246.330478:0:8063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789127246.330496:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752726528 00000100:00100000:3.0:1789127246.330499:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752726528 00000100:00100000:3.0:1789127246.330524:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789127246.330530:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae91b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876035752726528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127246.330559:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae91b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876035752726528:12345-0@lo:400:kworker.0 Request processed in 30us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127246.330565:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:3.0:1789127246.330595:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789127246.330599:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789127246.330630:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df7ae91ad00 x1876035752726784/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127262 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127246.330644:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae91ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1876035752726784:0@lo:400:kworker.0 00000100:00100000:3.0:1789127246.330671:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae91b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876035752726528:0@lo:400:kworker.0 00010000:00080000:3.0:1789127246.330681:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df7ae91bc00 x1876035752727040/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127262 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127246.330689:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae91bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752727040:0@lo:400:kworker.0 00000100:00100000:0.0:1789127246.335673:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127246.335876:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752726656 00000100:00100000:0.0:1789127246.335883:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752726656 00000100:00100000:0.0:1789127246.335933:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789127246.335943:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79062bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876035752726656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127246.335994:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79062bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876035752726656:12345-0@lo:400:kworker.0 Request processed in 53us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127246.336001:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789127246.336019:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789127246.336030:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df790628f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752727168:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789127246.336066:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789127246.336113:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789127246.336126:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752727168 00000100:00100000:0.0:1789127246.336130:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752727168 00000100:00100000:0.0:1789127246.336158:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789127246.336164:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df790628b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876035752727168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789127246.336192:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789127246.336237:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df790628b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876035752727168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127246.336243:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1789127246.337072:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df790628f00 x1876035752727168/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127262 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127246.337094:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df790628f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752727168:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789127246.346021:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae918b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1876035752726656:0@lo:400:kworker.0 00000100:00100000:1.0:1789127246.349275:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127246.349352:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae91b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1876035752726912:0@lo:400:kworker.0 00000100:00100000:2.0:1789127246.349401:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752726400 00000100:00100000:2.0:1789127246.349410:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752726400 00000100:00100000:1.0:1789127246.349410:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127246.349467:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1789127246.349477:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df787bb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:3301:x1876035752726400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127246.349540:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df787bb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:3301:x1876035752726400:12345-0@lo:400:kworker.0 Request processed in 64us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127246.349547:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1789127246.349621:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752726912 00000100:00100000:3.0:1789127246.349626:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752726912 00000100:00100000:3.0:1789127246.349675:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789127246.349681:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bfc4b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876035752726912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127246.349719:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bfc4b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876035752726912:12345-0@lo:400:kworker.0 Request processed in 38us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127246.349726:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789127246.350071:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae919680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3301:1876035752726400:0@lo:400:kworker.0 00000100:00100000:1.0:1789127246.350086:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae91b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1876035752726912:0@lo:400:kworker.0 00000100:00080000:2.0:1789127246.350200:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789127246.567370:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127246.567421:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127246.567457:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127246.567483:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127246.567509:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733822336 00000100:00100000:3.0:1789127246.567518:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733822336 00000100:00100000:3.0:1789127246.567575:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 196 00000100:00100000:3.0:1789127246.567584:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df787bb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d829a69b-d740-4e4c-8301-ef09c9d45165+10:2347:x1876035733822336:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:3.0:1789127246.567649:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df787bb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d829a69b-d740-4e4c-8301-ef09c9d45165+10:2347:x1876035733822336:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 67us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127246.567657:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 196 00000100:00100000:3.0:1789127246.567687:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733822720 00000100:00100000:3.0:1789127246.567691:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733822720 00000100:00100000:3.0:1789127246.567724:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733822592 00000100:00100000:3.0:1789127246.567728:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733822592 00000100:00100000:3.0:1789127246.567747:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 18 00000100:00100000:3.0:1789127246.567753:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae91b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+5:2347:x1876035733822720:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:3.0:1789127246.567782:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae91b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+5:2347:x1876035733822720:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 28us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127246.567835:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 18 00000100:00100000:3.0:1789127246.567848:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 19 00000100:00100000:3.0:1789127246.567854:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae91ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+5:2347:x1876035733822592:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:3.0:1789127246.567879:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae91ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+5:2347:x1876035733822592:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 26us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127246.567884:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 19 00000100:00080000:3.0:1789127246.568010:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789127246.568014:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789127246.568094:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733822464 00000100:00100000:0.0:1789127246.568099:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733822464 00000100:00100000:0.0:1789127246.568146:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 37 00000100:00100000:0.0:1789127246.568152:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae91bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+6:2347:x1876035733822464:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:0.0:1789127246.568189:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae91bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+6:2347:x1876035733822464:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 37us (828us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127246.568194:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 37 00000100:00080000:3.0:1789127246.569111:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789127247.284563:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127247.359709:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789127247.359739:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79062f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1876035752727296:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789127247.359828:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127247.359891:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752727296 00000100:00100000:2.0:1789127247.359898:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752727296 00000100:00100000:2.0:1789127247.359941:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789127247.359949:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79062e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876035752727296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789127247.359985:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789127247.360025:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79062e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876035752727296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127247.360032:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:2.0:1789127247.360072:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df79062f480 x1876035752727296/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127263 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127247.360088:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79062f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1876035752727296:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789127248.310044:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127249.331543:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127250.356971:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789127250.460328:0:9055:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg640-server.virtnet: executing yml_node 00010000:00010000:3.0:1789127251.380424:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127251.445341:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae919e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3301:1876035752727424:0@lo:400:kworker.0 00000100:00100000:3.0:1789127251.445353:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae91a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1876035752727808:0@lo:400:kworker.0 00000100:00100000:0.0:1789127251.446928:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae9192c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876035752727680:0@lo:400:kworker.0 00000100:00100000:3.0:1789127251.447893:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127251.447931:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752727808 00000100:00100000:1.0:1789127251.447940:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752727808 00000100:00100000:3.0:1789127251.447966:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789127251.447975:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae91b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1876035752727936:0@lo:400:kworker.0 00000100:00100000:1.0:1789127251.447995:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789127251.448005:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6811c4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876035752727808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127251.448057:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6811c4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876035752727808:12345-0@lo:400:kworker.0 Request processed in 54us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127251.448065:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:1.0:1789127251.448086:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789127251.448244:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127251.448244:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127251.448300:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae91a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1876035752727808:0@lo:400:kworker.0 00000100:00100000:0.0:1789127251.448360:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127251.448450:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae918b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1876035752728192:0@lo:400:kworker.0 00000100:00100000:0.0:1789127251.448474:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127251.448493:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789127251.448498:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79062f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1876035752727552:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789127251.448519:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127251.448534:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae919680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1876035752728064:0@lo:400:kworker.0 00000100:00100000:0.0:1789127251.448553:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127251.448607:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752727936 00000100:00100000:1.0:1789127251.448612:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752727936 00000100:00100000:1.0:1789127251.448657:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752728192 00000100:00100000:1.0:1789127251.448660:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752728192 00000100:00100000:1.0:1789127251.448693:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789127251.448697:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752727680 00000100:00100000:2.0:1789127251.448700:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752727680 00000100:00100000:1.0:1789127251.448700:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6811c6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1876035752727936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127251.448717:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752728064 00000100:00100000:2.0:1789127251.448719:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752728064 00000100:00100000:2.0:1789127251.448733:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789127251.448737:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6811c6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1876035752727936:12345-0@lo:400:kworker.0 Request processed in 38us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127251.448739:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79062b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876035752727680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127251.448743:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789127251.448754:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789127251.448759:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79062a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1876035752728192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127251.448771:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79062b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876035752727680:12345-0@lo:400:kworker.0 Request processed in 33us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127251.448778:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789127251.448781:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79062a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1876035752728192:12345-0@lo:400:kworker.0 Request processed in 23us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127251.448809:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789127251.448825:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752727424 00000100:00100000:1.0:1789127251.448829:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752727424 00000100:00100000:1.0:1789127251.448853:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1789127251.448859:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df787bb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:3301:x1876035752727424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127251.448893:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df787bb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:3301:x1876035752727424:12345-0@lo:400:kworker.0 Request processed in 34us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127251.448899:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00010000:00080000:1.0:1789127251.448935:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df7ae91b0c0 x1876035752727936/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127267 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127251.448945:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae91b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1876035752727936:0@lo:400:kworker.0 00000100:00080000:1.0:1789127251.448962:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789127251.448965:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789127251.448967:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789127251.448980:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789127251.448987:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df790628780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876035752728064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127251.449020:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df790628780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876035752728064:12345-0@lo:400:kworker.0 Request processed in 34us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127251.449025:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789127251.449054:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae919e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3301:1876035752727424:0@lo:400:kworker.0 00000100:00100000:0.0:1789127251.449341:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752727552 00000100:00100000:0.0:1789127251.449352:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752727552 00000100:00100000:0.0:1789127251.449424:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789127251.449431:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df790629680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876035752727552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789127251.449457:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789127251.449488:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df790629680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876035752727552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (968us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127251.449493:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1789127251.449559:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df79062f480 x1876035752727552/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127267 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127251.449574:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79062f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1876035752727552:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789127251.449586:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae919680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1876035752728064:0@lo:400:kworker.0 00000100:00100000:0.0:1789127251.449595:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae9192c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876035752727680:0@lo:400:kworker.0 00010000:00080000:0.0:1789127251.449602:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df7ae918b40 x1876035752728192/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127267 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127251.449610:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae918b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1876035752728192:0@lo:400:kworker.0 00000100:00100000:0.0:1789127251.703688:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127251.703731:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127251.703985:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733823104 00000100:00100000:3.0:1789127251.703994:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733823104 00000100:00100000:3.0:1789127251.704050:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 10 00000100:00100000:3.0:1789127251.704059:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79062a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+5:2345:x1876035733823104:12345-192.168.206.40@tcp:9:kworker.0 00000020:00000080:3.0:1789127251.704090:0:6688:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xeeacf7c0243003c4 00000100:00080000:3.0:1789127251.704098:0:6688:0:(import.c:65:import_set_state_nolock()) ffff8df682ad8000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789127251.704191:0:6688:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1789127251.704516:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79062a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+2:2345:x1876035733823104:12345-192.168.206.40@tcp:9:kworker.0 Request processed in 457us (837us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127251.704524:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 10 00000100:00100000:3.0:1789127251.704549:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733822848 00000100:00100000:3.0:1789127251.704552:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733822848 00000100:00100000:3.0:1789127251.704575:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 198 00000100:00100000:3.0:1789127251.704581:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df787bbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d829a69b-d740-4e4c-8301-ef09c9d45165+10:2346:x1876035733822848:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:3.0:1789127251.704603:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df787bbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d829a69b-d740-4e4c-8301-ef09c9d45165+10:2346:x1876035733822848:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 23us (873us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127251.704609:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 198 00000100:00080000:3.0:1789127251.704630:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789127251.704680:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127251.706102:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127251.708669:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733822976 00000100:00100000:3.0:1789127251.708684:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733822976 00000100:00100000:3.0:1789127251.708770:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 41 00000100:00100000:3.0:1789127251.708779:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7906283c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+6:2346:x1876035733822976:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:3.0:1789127251.708912:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7906283c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+6:2346:x1876035733822976:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 133us (2817us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127251.708920:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 41 00000100:00100000:3.0:1789127251.709053:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127251.709160:0:8063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733823232 00000100:00100000:3.0:1789127251.709165:0:8063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733823232 00000100:00100000:3.0:1789127251.709195:0:8063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 11 00000100:00100000:3.0:1789127251.709202:0:8063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6811c7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+5:2345:x1876035733823232:12345-192.168.206.40@tcp:9:kworker.0 00000020:00000080:3.0:1789127251.709226:0:8063:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xeeacf7c0243003cb 00000100:00080000:3.0:1789127251.709234:0:8063:0:(import.c:65:import_set_state_nolock()) ffff8df7903a6000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789127251.709268:0:8063:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1789127251.709559:0:8063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6811c7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+2:2345:x1876035733823232:12345-192.168.206.40@tcp:9:kworker.0 Request processed in 356us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127251.709566:0:8063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 11 00010000:00010000:3.0:1789127251.709617:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789127251.710070:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789127251.710075:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789127252.403068:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127252.469554:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789127252.469583:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6811c4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1876035752728320:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789127252.469675:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127252.469764:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752728320 00000100:00100000:3.0:1789127252.469772:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752728320 00000100:00100000:3.0:1789127252.469850:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789127252.469860:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6811c6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876035752728320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789127252.469898:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789127252.469946:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6811c6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876035752728320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127252.469968:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:3.0:1789127252.470010:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df6811c4b40 x1876035752728320/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127268 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127252.470029:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6811c4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1876035752728320:0@lo:13:osp-pre-0-0.0 00000001:00100000:2.0:1789127252.519098:0:6714:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 28762f98-a240-4662-a754-e28bbeb6cb4b 00000020:00000080:2.0:1789127252.519110:0:6714:0:(genops.c:885:class_export_put()) final put ffff8df682ada800/28762f98-a240-4662-a754-e28bbeb6cb4b 00000020:00000080:0.0:1789127252.519212:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df682ada800/28762f98-a240-4662-a754-e28bbeb6cb4b for lustre-OST0000 00000020:00000080:0.0:1789127252.519977:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df682ad8000 for lustre-OST0000 00010000:00010000:3.0:1789127253.427200:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127254.452138:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789127255.176636:0:9248:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.135 00010000:00010000:3.0:1789127255.478974:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789127255.612280:0:7646:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 28762f98-a240-4662-a754-e28bbeb6cb4b 00000020:00000080:1.0:1789127255.612299:0:7646:0:(genops.c:885:class_export_put()) final put ffff8df7903a5000/28762f98-a240-4662-a754-e28bbeb6cb4b 00000020:00000080:2.0:1789127255.612462:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df7903a5000/28762f98-a240-4662-a754-e28bbeb6cb4b for lustre-OST0001 00000020:00000080:2.0:1789127255.612516:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df7903a6000 for lustre-OST0001 00010000:00010000:0.0:1789127256.498965:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127256.565763:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79062de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1876035752728448:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789127256.565881:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127256.566101:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df790629a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876035752728704:0@lo:400:kworker.0 00000100:00100000:0.0:1789127256.566137:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127256.566176:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789127256.566182:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df790628000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3303:1876035752728576:0@lo:400:kworker.0 00000100:00100000:0.0:1789127256.566210:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127256.566231:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79062a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1876035752729088:0@lo:400:kworker.0 00000100:00100000:0.0:1789127256.566254:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127256.566286:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752728704 00000100:00100000:0.0:1789127256.566307:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752728704 00000100:00100000:0.0:1789127256.566372:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752729088 00000100:00100000:0.0:1789127256.566376:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752729088 00000100:00100000:0.0:1789127256.566406:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789127256.566427:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df790628f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876035752728704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127256.566490:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df790628f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876035752728704:12345-0@lo:400:kworker.0 Request processed in 74us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127256.566498:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789127256.566515:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789127256.566522:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79062b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876035752729088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127256.566549:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79062b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876035752729088:12345-0@lo:400:kworker.0 Request processed in 28us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127256.566555:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:0.0:1789127256.566578:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789127256.566611:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79062a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1876035752729088:0@lo:400:kworker.0 00000100:00100000:0.0:1789127256.566622:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df790629a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876035752728704:0@lo:400:kworker.0 00000100:00100000:0.0:1789127256.566649:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7906292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1876035752728960:0@lo:400:kworker.0 00000100:00100000:0.0:1789127256.566676:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127256.566700:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789127256.566706:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df790629e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1876035752728832:0@lo:400:kworker.0 00000100:00100000:0.0:1789127256.566736:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127256.566763:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752728960 00000100:00100000:0.0:1789127256.566767:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752728960 00000100:00100000:0.0:1789127256.566835:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789127256.566843:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df790629a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1876035752728960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127256.566880:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df790629a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1876035752728960:12345-0@lo:400:kworker.0 Request processed in 38us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127256.566887:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:0.0:1789127256.566905:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789127256.566912:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752728832 00000100:00100000:0.0:1789127256.566915:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752728832 00000100:00100000:0.0:1789127256.566939:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789127256.566944:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79062a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876035752728832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127256.566970:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79062a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876035752728832:12345-0@lo:400:kworker.0 Request processed in 27us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127256.566976:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:0.0:1789127256.566990:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789127256.567005:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df790629e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1876035752728832:0@lo:400:kworker.0 00010000:00080000:0.0:1789127256.567019:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df7906292c0 x1876035752728960/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127272 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127256.567029:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7906292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1876035752728960:0@lo:400:kworker.0 00000100:00100000:2.0:1789127256.567289:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752728448 00000100:00100000:2.0:1789127256.567294:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752728448 00000100:00100000:2.0:1789127256.567352:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789127256.567361:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6811c70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876035752728448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789127256.567396:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789127256.567448:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6811c70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876035752728448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (1568us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127256.567455:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789127256.567660:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752728576 00000100:00100000:1.0:1789127256.567665:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752728576 00000100:00100000:1.0:1789127256.567704:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1789127256.567712:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df787bba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:3303:x1876035752728576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127256.567764:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df787bba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:3303:x1876035752728576:12345-0@lo:400:kworker.0 Request processed in 54us (1552us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127256.567771:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00080000:0.0:1789127256.567908:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789127256.567934:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df79062de00 x1876035752728448/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127272 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127256.567952:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79062de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1876035752728448:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789127256.568040:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df790628000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3303:1876035752728576:0@lo:400:kworker.0 00000100:00100000:3.0:1789127256.808019:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127256.808086:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127256.808113:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733823488 00000100:00100000:0.0:1789127256.808128:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733823488 00000100:00100000:0.0:1789127256.808215:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 45 00000100:00100000:0.0:1789127256.808227:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6811c7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+6:2348:x1876035733823488:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:2.0:1789127256.808374:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733823360 00000100:00100000:2.0:1789127256.808379:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733823360 00000100:00100000:2.0:1789127256.808422:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 200 00000100:00100000:2.0:1789127256.808431:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df787bb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d829a69b-d740-4e4c-8301-ef09c9d45165+10:2349:x1876035733823360:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:2.0:1789127256.808497:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df787bb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d829a69b-d740-4e4c-8301-ef09c9d45165+10:2349:x1876035733823360:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 67us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127256.808523:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 200 00000100:00100000:0.0:1789127256.808836:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6811c7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+6:2348:x1876035733823488:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 609us (832us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127256.808843:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 45 00000100:00080000:3.0:1789127256.810130:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789127257.523499:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127257.587188:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789127257.587215:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6811c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752729216:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789127257.587311:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127257.587371:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752729216 00000100:00100000:2.0:1789127257.587382:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752729216 00000100:00100000:2.0:1789127257.587447:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789127257.587461:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6811c61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876035752729216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789127257.587525:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789127257.587578:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6811c61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876035752729216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127257.587586:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:3.0:1789127257.587627:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df6811c7480 x1876035752729216/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127273 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127257.587647:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6811c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752729216:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1789127258.057588:0:9347:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.135 00010000:00010000:3.0:1789127258.547040:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127259.571740:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127260.595274:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789127260.734990:0:9445:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.135 00010000:00010000:3.0:1789127261.619397:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127261.685263:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6811c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1876035752729600:0@lo:400:kworker.0 00000100:00100000:3.0:1789127261.685375:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127261.685455:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789127261.685462:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6811c43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752729728:0@lo:400:kworker.0 00000100:00100000:3.0:1789127261.685491:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127261.685535:0:8063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752729728 00000100:00100000:3.0:1789127261.685543:0:8063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752729728 00000100:00100000:0.0:1789127261.685660:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6811c5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876035752729472:0@lo:400:kworker.0 00000100:00100000:0.0:1789127261.685694:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127261.685713:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6811c5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1876035752729984:0@lo:400:kworker.0 00000100:00100000:0.0:1789127261.685735:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127261.685763:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789127261.685769:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6811c5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3301:1876035752729344:0@lo:400:kworker.0 00000100:00100000:0.0:1789127261.685837:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127261.685864:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6811c6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1876035752729856:0@lo:400:kworker.0 00000100:00100000:0.0:1789127261.685886:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127261.685913:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752729600 00000100:00100000:0.0:1789127261.685917:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752729600 00000100:00100000:0.0:1789127261.685975:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752729472 00000100:00100000:0.0:1789127261.685978:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752729472 00000100:00100000:0.0:1789127261.685991:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752729856 00000100:00100000:0.0:1789127261.685993:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752729856 00000100:00100000:0.0:1789127261.686010:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789127261.686019:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6811c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876035752729600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127261.686117:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6811c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876035752729600:12345-0@lo:400:kworker.0 Request processed in 99us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127261.686125:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789127261.686145:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789127261.686151:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df790629e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876035752729472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127261.686190:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df790629e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876035752729472:12345-0@lo:400:kworker.0 Request processed in 40us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127261.686196:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789127261.686206:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789127261.686212:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df790628000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876035752729856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127261.686239:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df790628000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876035752729856:12345-0@lo:400:kworker.0 Request processed in 28us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127261.686245:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789127261.686264:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752729984 00000100:00100000:0.0:1789127261.686268:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752729984 00000100:00100000:0.0:1789127261.686500:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789127261.686509:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7906292c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1876035752729984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127261.686544:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7906292c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1876035752729984:12345-0@lo:400:kworker.0 Request processed in 37us (808us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127261.686735:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789127261.686764:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752729344 00000100:00100000:0.0:1789127261.686769:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752729344 00000100:00100000:0.0:1789127261.686925:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1789127261.686933:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df788035050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:3301:x1876035752729344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127261.686970:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df788035050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:3301:x1876035752729344:12345-0@lo:400:kworker.0 Request processed in 37us (1132us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127261.686993:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00080000:0.0:1789127261.687027:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789127261.687032:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789127261.687066:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6811c5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3301:1876035752729344:0@lo:400:kworker.0 00000100:00100000:0.0:1789127261.687081:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6811c6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1876035752729856:0@lo:400:kworker.0 00000100:00100000:0.0:1789127261.687093:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6811c5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876035752729472:0@lo:400:kworker.0 00010000:00080000:0.0:1789127261.687105:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df6811c5680 x1876035752729984/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127277 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127261.687116:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6811c5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1876035752729984:0@lo:400:kworker.0 00000100:00100000:0.0:1789127261.687157:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6811c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1876035752729600:0@lo:400:kworker.0 00000100:00100000:2.0:1789127261.687590:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789127261.687604:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79062d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1876035752730112:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789127261.687644:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127261.687691:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752730112 00000100:00100000:2.0:1789127261.687696:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752730112 00000100:00100000:2.0:1789127261.687727:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789127261.687733:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79062f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876035752730112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789127261.687765:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789127261.687840:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79062f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876035752730112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127261.687847:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1789127261.687883:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df79062d2c0 x1876035752730112/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127277 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127261.687899:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79062d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1876035752730112:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789127261.688817:0:8063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789127261.688832:0:8063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6811c52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1876035752729728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127261.688907:0:8063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6811c52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1876035752729728:12345-0@lo:400:kworker.0 Request processed in 80us (3414us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127261.688914:0:8063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1789127261.689103:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789127261.689184:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df6811c43c0 x1876035752729728/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127277 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127261.689197:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6811c43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752729728:0@lo:400:kworker.0 00000100:00100000:3.0:1789127261.930623:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127261.930675:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127261.932304:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733823616 00000100:00100000:2.0:1789127261.932347:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733823616 00000100:00100000:2.0:1789127261.932438:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 202 00000100:00100000:2.0:1789127261.932450:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df788035850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d829a69b-d740-4e4c-8301-ef09c9d45165+10:2349:x1876035733823616:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:2.0:1789127261.932554:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df788035850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d829a69b-d740-4e4c-8301-ef09c9d45165+10:2349:x1876035733823616:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 105us (1943us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127261.932563:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 202 00000100:00100000:0.0:1789127261.933921:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733823744 00000100:00100000:0.0:1789127261.933934:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733823744 00000100:00100000:0.0:1789127261.934021:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 49 00000100:00100000:0.0:1789127261.934030:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6811c4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+6:2349:x1876035733823744:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:0.0:1789127261.934106:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6811c4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+6:2349:x1876035733823744:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 77us (3429us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127261.934113:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 49 00000100:00080000:3.0:1789127261.934635:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789127262.645933:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127262.707547:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789127262.707577:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7bfc49680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752730240:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789127262.707683:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127262.708066:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752730240 00000100:00100000:1.0:1789127262.708081:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752730240 00000100:00100000:1.0:1789127262.708139:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789127262.708149:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79a2c5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876035752730240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789127262.708192:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789127262.708249:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79a2c5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876035752730240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127262.708257:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:1.0:1789127262.708299:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df7bfc49680 x1876035752730240/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127278 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127262.708333:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7bfc49680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752730240:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1789127262.892605:0:9494:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Fri Sep 11 07:47:39 EDT 2026 00010000:00010000:0.0:1789127263.668128:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127264.698191:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127265.719062:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127266.739227:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127266.803218:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79062fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1876035752730368:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789127266.803324:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127266.803462:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752730368 00000100:00100000:2.0:1789127266.803472:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752730368 00000100:00100000:2.0:1789127266.803551:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789127266.803561:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bfc49680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876035752730368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789127266.803604:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789127266.803658:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bfc49680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876035752730368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127266.803667:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1789127266.803718:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df79062fc00 x1876035752730368/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127282 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127266.803737:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79062fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1876035752730368:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789127266.803819:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789127266.804723:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7bfc49e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876035752730624:0@lo:400:kworker.0 00000100:00100000:1.0:1789127266.804779:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127266.804835:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789127266.804841:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7bfc49a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1876035752730752:0@lo:400:kworker.0 00000100:00100000:1.0:1789127266.804868:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127266.804901:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752730624 00000100:00100000:1.0:1789127266.804907:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752730624 00000100:00100000:1.0:1789127266.804962:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752730752 00000100:00100000:1.0:1789127266.804966:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752730752 00000100:00100000:1.0:1789127266.804989:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789127266.804996:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeae4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876035752730624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127266.805064:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeae4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876035752730624:12345-0@lo:400:kworker.0 Request processed in 68us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127266.805070:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789127266.805086:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789127266.805092:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79a3a21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876035752730752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127266.805229:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7aeae52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1876035752730880:0@lo:400:kworker.0 00000100:00100000:3.0:1789127266.805329:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7bfc4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3301:1876035752730496:0@lo:400:kworker.0 00000100:00100000:1.0:1789127266.808644:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79a3a21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876035752730752:12345-0@lo:400:kworker.0 Request processed in 3538us (3762us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127266.808662:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:1.0:1789127266.808728:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789127266.808803:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7bfc49a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1876035752730752:0@lo:400:kworker.0 00000100:00100000:1.0:1789127266.808821:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7bfc49e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876035752730624:0@lo:400:kworker.0 00000100:00100000:1.0:1789127266.818133:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127266.819133:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127266.819189:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7aeae5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1876035752731008:0@lo:400:kworker.0 00000100:00100000:3.0:1789127266.819240:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127266.819413:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752730496 00000100:00100000:1.0:1789127266.819423:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752730496 00000100:00100000:1.0:1789127266.819484:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1789127266.819495:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df788034050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:3301:x1876035752730496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127266.819560:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df788034050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:3301:x1876035752730496:12345-0@lo:400:kworker.0 Request processed in 67us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127266.819569:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1789127266.819655:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752730880 00000100:00100000:2.0:1789127266.819661:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752730880 00000100:00100000:2.0:1789127266.819716:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789127266.819724:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79a3a2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1876035752730880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127266.819773:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79a3a2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1876035752730880:12345-0@lo:400:kworker.0 Request processed in 50us (1651us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127266.819779:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789127266.819856:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752731008 00000100:00100000:2.0:1789127266.819860:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752731008 00000100:00100000:2.0:1789127266.819890:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789127266.819896:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6811c5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876035752731008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127266.820043:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6811c5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876035752731008:12345-0@lo:400:kworker.0 Request processed in 146us (801us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127266.820050:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:2.0:1789127266.820095:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df7aeae52c0 x1876035752730880/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127282 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127266.820110:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7aeae52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1876035752730880:0@lo:400:kworker.0 00000100:00100000:3.0:1789127266.821010:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7bfc4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3301:1876035752730496:0@lo:400:kworker.0 00000100:00100000:3.0:1789127266.821027:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7aeae5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1876035752731008:0@lo:400:kworker.0 00000100:00080000:1.0:1789127266.821345:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789127266.821352:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789127267.057752:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127267.057853:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733823872 00000100:00100000:2.0:1789127267.057868:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733823872 00000100:00100000:3.0:1789127267.057916:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127267.057954:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 204 00000100:00100000:3.0:1789127267.057964:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733824000 00000100:00100000:2.0:1789127267.057973:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df788035450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d829a69b-d740-4e4c-8301-ef09c9d45165+10:2349:x1876035733823872:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:3.0:1789127267.057977:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733824000 00000100:00100000:3.0:1789127267.058069:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 53 00000100:00100000:3.0:1789127267.058079:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6811c6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+6:2349:x1876035733824000:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:3.0:1789127267.058151:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6811c6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+6:2349:x1876035733824000:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 74us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127267.058159:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 53 00000100:00080000:3.0:1789127267.058180:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789127267.062289:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df788035450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d829a69b-d740-4e4c-8301-ef09c9d45165+10:2349:x1876035733823872:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 4298us (4520us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127267.062307:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 204 00010000:00010000:3.0:1789127267.763030:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127267.832624:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6811c5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752731136:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789127267.832696:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127267.832822:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752731136 00000100:00100000:3.0:1789127267.832829:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752731136 00000100:00100000:3.0:1789127267.832882:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789127267.832891:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79a3a2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876035752731136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789127267.832926:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789127267.832977:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79a3a2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876035752731136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127267.832984:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1789127267.833024:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df6811c5e00 x1876035752731136/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127283 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127267.833044:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6811c5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752731136:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789127268.786945:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127269.813969:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127270.835552:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127271.859020:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127271.923004:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79062ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1876035752731264:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789127271.923124:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a3a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3300:1876035752731392:0@lo:400:kworker.0 00000100:00100000:3.0:1789127271.923162:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127271.923162:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127271.923213:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a3a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876035752731520:0@lo:400:kworker.0 00000100:00100000:0.0:1789127271.925128:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752731392 00000100:00100000:2.0:1789127271.925133:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127271.925138:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752731392 00000100:00100000:2.0:1789127271.925172:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752731520 00000100:00100000:2.0:1789127271.925176:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752731520 00000100:00100000:0.0:1789127271.925182:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1789127271.925190:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df788036c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:3300:x1876035752731392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127271.925201:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789127271.925206:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79062f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876035752731520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127271.925684:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79062f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876035752731520:12345-0@lo:400:kworker.0 Request processed in 475us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127271.925684:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df788036c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:3300:x1876035752731392:12345-0@lo:400:kworker.0 Request processed in 492us (2519us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127271.925693:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789127271.925693:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1789127271.925741:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a3a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876035752731520:0@lo:400:kworker.0 00000100:00100000:2.0:1789127271.925783:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752731264 00000100:00100000:2.0:1789127271.925820:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752731264 00000100:00100000:2.0:1789127271.925861:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789127271.925867:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6811c5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876035752731264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789127271.925898:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789127271.926440:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a3a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3300:1876035752731392:0@lo:400:kworker.0 00000100:00100000:0.0:1789127271.926479:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a3a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1876035752731648:0@lo:400:kworker.0 00000100:00100000:0.0:1789127271.928056:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789127271.929482:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789127271.929520:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752731648 00000100:00100000:0.0:1789127271.929528:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752731648 00000100:00100000:2.0:1789127271.930178:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6811c5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876035752731264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4306us (7011us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127271.930189:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:3.0:1789127271.930515:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789127271.933262:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789127271.933307:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a3a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752731776:0@lo:400:kworker.0 00000100:00100000:3.0:1789127271.934575:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127271.934636:0:8063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752731776 00000100:00100000:3.0:1789127271.934644:0:8063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752731776 00000100:00100000:3.0:1789127271.934704:0:8063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789127271.934714:0:8063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6811c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1876035752731776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127271.934770:0:8063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6811c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1876035752731776:12345-0@lo:400:kworker.0 Request processed in 57us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127271.934778:0:8063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1789127271.934819:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789127271.934916:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df79a3a0000 x1876035752731776/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127287 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127271.934931:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a3a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752731776:0@lo:400:kworker.0 00000100:00100000:3.0:1789127271.934974:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a3a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1876035752731904:0@lo:400:kworker.0 00000100:00100000:3.0:1789127271.935007:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1789127271.936203:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df79062ed00 x1876035752731264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127287 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127271.936227:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79062ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1876035752731264:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789127271.937967:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752731904 00000100:00100000:0.0:1789127271.937979:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752731904 00000100:00080000:3.0:1789127271.938108:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789127271.938153:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789127271.938162:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bbd843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876035752731648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127271.938297:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bbd843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876035752731648:12345-0@lo:400:kworker.0 Request processed in 135us (10246us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127271.938305:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789127271.938322:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789127271.938329:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6811c5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876035752731904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127271.938367:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6811c5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876035752731904:12345-0@lo:400:kworker.0 Request processed in 39us (3360us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127271.938385:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789127271.938418:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a3a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1876035752731904:0@lo:400:kworker.0 00000100:00100000:3.0:1789127271.938514:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a3a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1876035752731648:0@lo:400:kworker.0 00000100:00100000:3.0:1789127272.177728:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127272.177778:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127272.178020:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733824128 00000100:00100000:0.0:1789127272.178029:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733824128 00000100:00100000:0.0:1789127272.178086:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 206 00000100:00100000:0.0:1789127272.178097:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df788036850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d829a69b-d740-4e4c-8301-ef09c9d45165+10:2349:x1876035733824128:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:0.0:1789127272.178171:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df788036850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d829a69b-d740-4e4c-8301-ef09c9d45165+10:2349:x1876035733824128:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 75us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127272.178179:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 206 00000100:00100000:1.0:1789127272.179780:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733824256 00000100:00100000:1.0:1789127272.179844:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733824256 00000100:00080000:3.0:1789127272.179991:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789127272.180046:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 57 00000100:00100000:2.0:1789127272.180057:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6811c4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+6:2349:x1876035733824256:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:2.0:1789127272.180132:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6811c4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+6:2349:x1876035733824256:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 78us (2354us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127272.180139:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 57 00010000:00010000:3.0:1789127272.887376:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127272.948861:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae918b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1876035752732032:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789127272.948932:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127272.949644:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752732032 00000100:00100000:0.0:1789127272.949653:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752732032 00000100:00100000:0.0:1789127272.949705:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789127272.949714:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae9192c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876035752732032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789127272.949752:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789127272.949828:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae9192c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876035752732032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (896us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127272.949836:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:3.0:1789127272.950397:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df7ae918b40 x1876035752732032/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127288 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127272.950418:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae918b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1876035752732032:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789127273.908382:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127274.938685:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127275.956429:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127276.979585:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127277.043295:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789127277.043319:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79062c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1876035752732160:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789127277.043389:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127277.043669:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79062c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1876035752732544:0@lo:400:kworker.0 00000100:00100000:2.0:1789127277.043710:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127277.043731:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789127277.043736:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79062e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876035752732416:0@lo:400:kworker.0 00000100:00100000:2.0:1789127277.043753:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127277.043776:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752732544 00000100:00100000:2.0:1789127277.043782:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752732544 00000100:00100000:2.0:1789127277.043843:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752732416 00000100:00100000:2.0:1789127277.043846:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752732416 00000100:00100000:2.0:1789127277.043859:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789127277.043865:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79062ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876035752732544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127277.043922:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79062ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876035752732544:12345-0@lo:400:kworker.0 Request processed in 57us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127277.043928:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789127277.043943:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789127277.043947:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79062fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876035752732416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127277.043967:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79062fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876035752732416:12345-0@lo:400:kworker.0 Request processed in 20us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127277.043972:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:2.0:1789127277.043986:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789127277.044014:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79062e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876035752732416:0@lo:400:kworker.0 00000100:00100000:2.0:1789127277.044022:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79062c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1876035752732544:0@lo:400:kworker.0 00000100:00100000:0.0:1789127277.048089:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79062c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752732672:0@lo:400:kworker.0 00000100:00100000:0.0:1789127277.048165:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127277.048239:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789127277.048248:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79062d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3302:1876035752732288:0@lo:400:kworker.0 00000100:00100000:0.0:1789127277.048288:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127277.048312:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79062da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1876035752732800:0@lo:400:kworker.0 00000100:00100000:0.0:1789127277.048393:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127277.048429:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752732160 00000100:00100000:0.0:1789127277.048435:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752732160 00000100:00100000:0.0:1789127277.048488:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789127277.048497:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79a3a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876035752732160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789127277.048545:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789127277.048585:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79a3a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876035752732160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (5196us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127277.048592:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789127277.048620:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752732288 00000100:00100000:0.0:1789127277.048624:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752732288 00000100:00100000:0.0:1789127277.048649:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1789127277.048656:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df788035c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:3302:x1876035752732288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127277.048689:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df788035c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:3302:x1876035752732288:12345-0@lo:400:kworker.0 Request processed in 34us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127277.048695:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00080000:0.0:1789127277.048724:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789127277.048735:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752732800 00000100:00100000:0.0:1789127277.048738:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752732800 00000100:00100000:0.0:1789127277.048771:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789127277.048777:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bbd86580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876035752732800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127277.048851:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bbd86580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876035752732800:12345-0@lo:400:kworker.0 Request processed in 74us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127277.048858:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:0.0:1789127277.048884:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789127277.048908:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79062d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3302:1876035752732288:0@lo:400:kworker.0 00000100:00100000:0.0:1789127277.048919:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79062da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1876035752732800:0@lo:400:kworker.0 00010000:00080000:1.0:1789127277.049121:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df79062c780 x1876035752732160/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127293 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127277.049139:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79062c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1876035752732160:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789127277.049463:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752732672 00000100:00100000:2.0:1789127277.049467:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752732672 00000100:00100000:2.0:1789127277.049518:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789127277.049526:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bbd85680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1876035752732672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127277.049570:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bbd85680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1876035752732672:12345-0@lo:400:kworker.0 Request processed in 46us (1406us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127277.049576:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:0.0:1789127277.050016:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789127277.050044:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df79062c000 x1876035752732672/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127293 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127277.050055:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79062c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752732672:0@lo:400:kworker.0 00000100:00100000:3.0:1789127277.288537:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127277.288609:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127277.288615:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733824384 00000100:00100000:2.0:1789127277.288677:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733824512 00000100:00100000:2.0:1789127277.288687:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733824512 00000100:00100000:2.0:1789127277.288819:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 61 00000100:00080000:1.0:1789127277.288908:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789127277.289219:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae919e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+6:2349:x1876035733824512:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:2.0:1789127277.289331:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae919e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+6:2349:x1876035733824512:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 502us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127277.289339:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 61 00000100:00100000:0.0:1789127277.290347:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733824384 00000100:00100000:1.0:1789127277.298432:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 208 00000100:00100000:1.0:1789127277.298446:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df788036450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d829a69b-d740-4e4c-8301-ef09c9d45165+10:2349:x1876035733824384:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:1.0:1789127277.300088:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df788036450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d829a69b-d740-4e4c-8301-ef09c9d45165+10:2349:x1876035733824384:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 1637us (11558us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127277.300100:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 208 00010000:00010000:2.0:1789127278.006957:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127278.068380:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789127278.068402:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a3a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1876035752732928:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789127278.068469:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127278.068526:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752732928 00000100:00100000:1.0:1789127278.068532:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752732928 00000100:00100000:1.0:1789127278.068573:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789127278.068581:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79a3a1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876035752732928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789127278.068612:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789127278.068653:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79a3a1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876035752732928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127278.068660:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:1.0:1789127278.068699:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df79a3a12c0 x1876035752732928/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127294 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127278.068726:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a3a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1876035752732928:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789127279.039761:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127280.052494:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127281.075462:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127282.105297:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127282.166166:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae918b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1876035752733440:0@lo:400:kworker.0 00000100:00100000:3.0:1789127282.166252:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127282.166335:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789127282.166343:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae91b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3300:1876035752733056:0@lo:400:kworker.0 00000100:00100000:3.0:1789127282.166372:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127282.166397:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7b43143c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1876035752733568:0@lo:400:kworker.0 00000100:00100000:3.0:1789127282.166421:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127282.166463:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae919680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1876035752733312:0@lo:400:kworker.0 00000100:00100000:3.0:1789127282.166488:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127282.166507:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789127282.166512:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae91a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876035752733184:0@lo:400:kworker.0 00000100:00100000:3.0:1789127282.166554:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127282.166572:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7b4316940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1876035752733696:0@lo:400:kworker.0 00000100:00100000:3.0:1789127282.166596:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127282.166623:0:8063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752733440 00000100:00100000:3.0:1789127282.166629:0:8063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752733440 00000100:00100000:3.0:1789127282.166676:0:8063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752733696 00000100:00100000:3.0:1789127282.166679:0:8063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752733696 00000100:00100000:3.0:1789127282.166701:0:8063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789127282.166709:0:8063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b4315680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1876035752733440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127282.166757:0:8063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b4315680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1876035752733440:12345-0@lo:400:kworker.0 Request processed in 48us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127282.166764:0:8063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789127282.166825:0:8063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789127282.166832:0:8063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b4314b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1876035752733696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127282.166866:0:8063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b4314b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1876035752733696:12345-0@lo:400:kworker.0 Request processed in 34us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127282.166872:0:8063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789127282.166889:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752733056 00000100:00100000:3.0:1789127282.166892:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752733056 00000100:00100000:3.0:1789127282.166916:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1789127282.166921:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df788034c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:3300:x1876035752733056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127282.166951:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df788034c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:3300:x1876035752733056:12345-0@lo:400:kworker.0 Request processed in 29us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127282.166957:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1789127282.166982:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752733568 00000100:00100000:3.0:1789127282.166986:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752733568 00000100:00100000:3.0:1789127282.167004:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752733312 00000100:00100000:3.0:1789127282.167007:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752733312 00000100:00100000:3.0:1789127282.167018:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752733184 00000100:00100000:3.0:1789127282.167020:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752733184 00000100:00100000:3.0:1789127282.167031:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789127282.167037:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b4314780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876035752733568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127282.167065:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b4314780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876035752733568:12345-0@lo:400:kworker.0 Request processed in 28us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127282.167071:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789127282.167082:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789127282.167087:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b4316580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876035752733312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127282.167114:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b4316580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876035752733312:12345-0@lo:400:kworker.0 Request processed in 26us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127282.167128:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789127282.167139:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789127282.167144:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b4317840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876035752733184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127282.167172:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b4317840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876035752733184:12345-0@lo:400:kworker.0 Request processed in 27us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127282.167178:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:3.0:1789127282.167218:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789127282.167222:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789127282.167224:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789127282.167262:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae91a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876035752733184:0@lo:400:kworker.0 00010000:00080000:3.0:1789127282.167275:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df7b4316940 x1876035752733696/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127298 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127282.167285:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7b4316940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1876035752733696:0@lo:400:kworker.0 00000100:00100000:3.0:1789127282.167295:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae919680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1876035752733312:0@lo:400:kworker.0 00000100:00100000:3.0:1789127282.167326:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae91b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3300:1876035752733056:0@lo:400:kworker.0 00000100:00100000:3.0:1789127282.167334:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7b43143c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1876035752733568:0@lo:400:kworker.0 00010000:00080000:3.0:1789127282.167343:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df7ae918b40 x1876035752733440/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127298 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127282.167351:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae918b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1876035752733440:0@lo:400:kworker.0 00000100:00100000:1.0:1789127282.169496:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789127282.169518:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79062d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752733824:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789127282.169629:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127282.169720:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752733824 00000100:00100000:2.0:1789127282.169726:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752733824 00000100:00100000:2.0:1789127282.169777:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789127282.169807:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bfc49e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876035752733824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789127282.169842:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789127282.169889:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bfc49e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876035752733824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127282.169897:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1789127282.170053:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df79062d2c0 x1876035752733824/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127298 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127282.170072:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79062d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752733824:0@lo:13:osp-pre-1-0.0 00000001:02000400:0.0:1789127282.225854:0:10125:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 07:47:59 (1789127279) === 00000100:00100000:3.0:1789127282.411040:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127282.411075:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127282.411176:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733824768 00000100:00100000:0.0:1789127282.411185:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733824768 00000100:00100000:0.0:1789127282.411254:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 65 00000100:00100000:0.0:1789127282.411264:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b43143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+6:2346:x1876035733824768:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:0.0:1789127282.411333:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b43143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+6:2346:x1876035733824768:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 70us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127282.411341:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 65 00000100:00080000:3.0:1789127282.411645:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789127282.411708:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733824640 00000100:00100000:1.0:1789127282.411714:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733824640 00000100:00100000:1.0:1789127282.411754:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 210 00000100:00100000:1.0:1789127282.411762:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df788037c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d829a69b-d740-4e4c-8301-ef09c9d45165+10:2346:x1876035733824640:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:1.0:1789127282.411828:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df788037c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d829a69b-d740-4e4c-8301-ef09c9d45165+10:2346:x1876035733824640:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 66us (798us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127282.411835:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 210 00000100:00100000:3.0:1789127282.737565:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127282.737737:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733824896 00000100:00100000:0.0:1789127282.737746:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733824896 00000100:00100000:0.0:1789127282.737826:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 211 00000100:00100000:0.0:1789127282.737837:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df788036050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d829a69b-d740-4e4c-8301-ef09c9d45165+10:8114:x1876035733824896:12345-192.168.206.40@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789127282.737853:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127282.737872:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df7ae729600/0xeeacf7c02430048f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7a08 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127282.737897:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df7ae729600/0xeeacf7c02430048f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7a08 expref: 11 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127282.737919:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df7ae729600/0xeeacf7c02430048f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7a08 expref: 11 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127282.737929:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7ae729600, rc 0) 00000100:00100000:0.0:1789127282.737987:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df788036050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d829a69b-d740-4e4c-8301-ef09c9d45165+11:8114:x1876035733824896:12345-192.168.206.40@tcp:101:mount.lustre.0 Request processed in 152us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127282.737994:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 211 00000100:00100000:0.0:1789127282.749252:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127282.749432:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733825024 00000100:00100000:3.0:1789127282.749442:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733825024 00000100:00100000:3.0:1789127282.749494:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 212 00000100:00100000:3.0:1789127282.749504:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df788037450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d829a69b-d740-4e4c-8301-ef09c9d45165+11:8114:x1876035733825024:12345-192.168.206.40@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789127282.749922:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df788037450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d829a69b-d740-4e4c-8301-ef09c9d45165+11:8114:x1876035733825024:12345-192.168.206.40@tcp:501:mount.lustre.0 Request processed in 418us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127282.749929:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 212 00000100:00100000:3.0:1789127282.754961:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127282.755132:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733825152 00000100:00100000:1.0:1789127282.755141:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733825152 00000100:00100000:1.0:1789127282.755216:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 213 00000100:00100000:1.0:1789127282.755225:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df788034450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d829a69b-d740-4e4c-8301-ef09c9d45165+11:8114:x1876035733825152:12345-192.168.206.40@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789127282.755446:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df788034450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d829a69b-d740-4e4c-8301-ef09c9d45165+11:8114:x1876035733825152:12345-192.168.206.40@tcp:503:mount.lustre.0 Request processed in 221us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127282.755454:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 213 00000100:00100000:1.0:1789127282.767509:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127282.767592:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733825280 00000100:00100000:3.0:1789127282.767602:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733825280 00000100:00100000:3.0:1789127282.767657:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 214 00000100:00100000:3.0:1789127282.767666:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df788037850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d829a69b-d740-4e4c-8301-ef09c9d45165+11:8118:x1876035733825280:12345-192.168.206.40@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789127282.767952:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df788037850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d829a69b-d740-4e4c-8301-ef09c9d45165+11:8118:x1876035733825280:12345-192.168.206.40@tcp:502:llog_process_th.0 Request processed in 285us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127282.767960:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 214 00000100:00100000:3.0:1789127282.785744:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127282.785859:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733825408 00000100:00100000:2.0:1789127282.785869:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733825408 00000100:00100000:2.0:1789127282.785922:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 215 00000100:00100000:2.0:1789127282.785931:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df788037050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d829a69b-d740-4e4c-8301-ef09c9d45165+11:8118:x1876035733825408:12345-192.168.206.40@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789127282.786229:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df788037050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d829a69b-d740-4e4c-8301-ef09c9d45165+11:8118:x1876035733825408:12345-192.168.206.40@tcp:502:llog_process_th.0 Request processed in 298us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127282.786238:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 215 00000100:00100000:2.0:1789127282.794192:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127282.794350:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733825536 00000100:00100000:1.0:1789127282.794372:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733825536 00000100:00100000:1.0:1789127282.794424:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 216 00000100:00100000:1.0:1789127282.794434:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df788034850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d829a69b-d740-4e4c-8301-ef09c9d45165+11:8114:x1876035733825536:12345-192.168.206.40@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789127282.794450:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127282.794467:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df7bbd97c00/0xeeacf7c024300496 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7a32 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127282.794493:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df7bbd97c00/0xeeacf7c024300496 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7a32 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127282.794504:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df7bbd97c00/0xeeacf7c024300496 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7a32 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127282.794514:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7bbd97c00, rc 0) 00000100:00100000:1.0:1789127282.794568:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df788034850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d829a69b-d740-4e4c-8301-ef09c9d45165+12:8114:x1876035733825536:12345-192.168.206.40@tcp:101:mount.lustre.0 Request processed in 135us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127282.794575:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 216 00000100:00100000:1.0:1789127282.809908:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127282.810122:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733825664 00000100:00100000:3.0:1789127282.810132:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733825664 00000100:00100000:3.0:1789127282.810214:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 217 00000100:00100000:3.0:1789127282.810224:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7906c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d829a69b-d740-4e4c-8301-ef09c9d45165+12:8114:x1876035733825664:12345-192.168.206.40@tcp:256:mount.lustre.0 20000000:01000000:3.0:1789127282.810249:0:5822:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1789127282.810274:0:5822:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789127282.810278:0:5822:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1789127282.810281:0:5822:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1789127282.810284:0:5822:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1789127282.812540:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7906c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d829a69b-d740-4e4c-8301-ef09c9d45165+12:8114:x1876035733825664:12345-192.168.206.40@tcp:256:mount.lustre.0 Request processed in 2309us (2632us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127282.812555:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 217 00000100:00100000:2.0:1789127282.815587:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127282.815683:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733825792 00000100:00100000:0.0:1789127282.815693:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733825792 00000100:00100000:0.0:1789127282.815748:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 218 00000100:00100000:0.0:1789127282.815758:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7906c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d829a69b-d740-4e4c-8301-ef09c9d45165+12:8114:x1876035733825792:12345-192.168.206.40@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789127282.815775:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127282.815814:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df7ae729000/0xeeacf7c02430049d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7a39 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127282.815843:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df7ae729000/0xeeacf7c02430049d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7a39 expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127282.815855:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df7ae729000/0xeeacf7c02430049d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7a39 expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127282.815864:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7ae729000, rc 0) 00000100:00100000:0.0:1789127282.815918:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7906c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d829a69b-d740-4e4c-8301-ef09c9d45165+13:8114:x1876035733825792:12345-192.168.206.40@tcp:101:mount.lustre.0 Request processed in 162us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127282.815925:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 218 00000100:00100000:3.0:1789127282.818373:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127282.818476:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733825920 00000100:00100000:1.0:1789127282.818484:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733825920 00000100:00100000:1.0:1789127282.818535:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 219 00000100:00100000:1.0:1789127282.818543:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7906c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d829a69b-d740-4e4c-8301-ef09c9d45165+13:8114:x1876035733825920:12345-192.168.206.40@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789127282.818836:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7906c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d829a69b-d740-4e4c-8301-ef09c9d45165+13:8114:x1876035733825920:12345-192.168.206.40@tcp:501:mount.lustre.0 Request processed in 292us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127282.818854:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 219 00000100:00100000:3.0:1789127282.821530:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127282.821730:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733826048 00000100:00100000:1.0:1789127282.821740:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733826048 00000100:00100000:1.0:1789127282.821820:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 220 00000100:00100000:1.0:1789127282.821830:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7906c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d829a69b-d740-4e4c-8301-ef09c9d45165+13:8114:x1876035733826048:12345-192.168.206.40@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789127282.822046:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7906c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d829a69b-d740-4e4c-8301-ef09c9d45165+13:8114:x1876035733826048:12345-192.168.206.40@tcp:503:mount.lustre.0 Request processed in 216us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127282.822054:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 220 00000100:00100000:2.0:1789127282.826256:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127282.826344:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733826176 00000100:00100000:0.0:1789127282.826352:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733826176 00000100:00100000:0.0:1789127282.826409:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 221 00000100:00100000:0.0:1789127282.826419:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7906cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d829a69b-d740-4e4c-8301-ef09c9d45165+13:8122:x1876035733826176:12345-192.168.206.40@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789127282.826676:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7906cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d829a69b-d740-4e4c-8301-ef09c9d45165+13:8122:x1876035733826176:12345-192.168.206.40@tcp:502:llog_process_th.0 Request processed in 258us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127282.826685:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 221 00000100:00100000:0.0:1789127282.829861:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127282.829930:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733826304 00000100:00100000:3.0:1789127282.829939:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733826304 00000100:00100000:3.0:1789127282.829986:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 222 00000100:00100000:3.0:1789127282.829994:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7906ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d829a69b-d740-4e4c-8301-ef09c9d45165+13:8122:x1876035733826304:12345-192.168.206.40@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789127282.830389:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7906ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d829a69b-d740-4e4c-8301-ef09c9d45165+13:8122:x1876035733826304:12345-192.168.206.40@tcp:502:llog_process_th.0 Request processed in 393us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127282.830397:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 222 00000100:00100000:3.0:1789127282.849128:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127282.849374:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733826432 00000100:00100000:2.0:1789127282.849385:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733826432 00000100:00100000:2.0:1789127282.849446:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 10 00000100:00100000:2.0:1789127282.849455:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b4316940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2345:x1876035733826432:12345-192.168.206.40@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789127282.849484:0:5832:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from 81b0e267-d7e0-4043-b34e-eec2dc4c5a6b@192.168.206.40@tcp t0 exp 0000000000000000 cur 229 last 0 00000020:00000080:2.0:1789127282.849520:0:5832:0:(genops.c:1385:class_connect()) connect: client 81b0e267-d7e0-4043-b34e-eec2dc4c5a6b, cookie 0xeeacf7c0243004a4 00000004:00100000:2.0:1789127282.849550:0:5832:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1789127282.849851:0:5832:0:(import.c:65:import_set_state_nolock()) ffff8df790381800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789127282.849917:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b4316940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81b0e267-d7e0-4043-b34e-eec2dc4c5a6b+6:2345:x1876035733826432:12345-192.168.206.40@tcp:38:mount.lustre.0 Request processed in 461us (798us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127282.849925:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 10 00000100:00100000:2.0:1789127282.853044:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127282.853126:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127282.854937:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733826560 00000100:00100000:3.0:1789127282.854951:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733826560 00000100:00100000:3.0:1789127282.855023:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733826688 00000100:00100000:3.0:1789127282.855027:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733826688 00000100:00100000:3.0:1789127282.855046:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 11 00000100:00100000:3.0:1789127282.855054:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79062cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81b0e267-d7e0-4043-b34e-eec2dc4c5a6b+7:0:x1876035733826560:12345-192.168.206.40@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789127282.855096:0:5832:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00080000:1.0:1789127282.855332:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789127282.855408:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79062cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81b0e267-d7e0-4043-b34e-eec2dc4c5a6b+7:0:x1876035733826560:12345-192.168.206.40@tcp:41:mount.lustre.0 Request processed in 353us (2371us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127282.855416:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 11 00000100:00100000:3.0:1789127282.856361:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 12 00000100:00100000:3.0:1789127282.856375:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79062de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81b0e267-d7e0-4043-b34e-eec2dc4c5a6b+6:8114:x1876035733826688:12345-192.168.206.40@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789127282.856399:0:5832:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789127282.856580:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79062de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81b0e267-d7e0-4043-b34e-eec2dc4c5a6b+6:8114:x1876035733826688:12345-192.168.206.40@tcp:41:mount.lustre.0 Request processed in 207us (3451us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127282.856587:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 12 00000100:00100000:2.0:1789127282.858423:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127282.858628:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733826816 00000100:00100000:3.0:1789127282.858637:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733826816 00000100:00100000:3.0:1789127282.858702:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 13 00000100:00100000:3.0:1789127282.858711:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79062d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81b0e267-d7e0-4043-b34e-eec2dc4c5a6b+6:8114:x1876035733826816:12345-192.168.206.40@tcp:40:mount.lustre.0 00000100:00100000:3.0:1789127282.858808:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79062d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81b0e267-d7e0-4043-b34e-eec2dc4c5a6b+6:8114:x1876035733826816:12345-192.168.206.40@tcp:40:mount.lustre.0 Request processed in 78us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127282.858817:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 13 00000100:00100000:1.0:1789127282.866562:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127282.866611:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127282.866685:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127282.866836:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733826944 00000100:00100000:0.0:1789127282.866848:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733826944 00000100:00100000:0.0:1789127282.866896:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733827072 00000100:00100000:0.0:1789127282.866900:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733827072 00000100:00100000:0.0:1789127282.866923:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 12 00000100:00100000:0.0:1789127282.866932:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bfc4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2345:x1876035733826944:12345-192.168.206.40@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789127282.866966:0:6686:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 81b0e267-d7e0-4043-b34e-eec2dc4c5a6b@192.168.206.40@tcp t0 exp 0000000000000000 cur 229 last 0 00000020:00000080:0.0:1789127282.867004:0:6686:0:(genops.c:1385:class_connect()) connect: client 81b0e267-d7e0-4043-b34e-eec2dc4c5a6b, cookie 0xeeacf7c0243004ab 00002000:00100000:0.0:1789127282.867024:0:6686:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 81b0e267-d7e0-4043-b34e-eec2dc4c5a6b/ffff8df681ad7000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113987 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789127282.867056:0:6686:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789127282.867350:0:6686:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789127282.867380:0:6686:0:(import.c:65:import_set_state_nolock()) ffff8df681ad0000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789127282.867440:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bfc4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:81b0e267-d7e0-4043-b34e-eec2dc4c5a6b+6:2345:x1876035733826944:12345-192.168.206.40@tcp:8:mount.lustre.0 Request processed in 507us (828us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127282.867448:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 12 00000100:00100000:0.0:1789127282.867465:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 13 00000100:00100000:0.0:1789127282.867470:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae959680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2345:x1876035733827072:12345-192.168.206.40@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789127282.867496:0:6686:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 81b0e267-d7e0-4043-b34e-eec2dc4c5a6b@192.168.206.40@tcp t0 exp 0000000000000000 cur 229 last 0 00000020:00000080:0.0:1789127282.867512:0:6686:0:(genops.c:1385:class_connect()) connect: client 81b0e267-d7e0-4043-b34e-eec2dc4c5a6b, cookie 0xeeacf7c0243004b2 00002000:00100000:0.0:1789127282.867519:0:6686:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 81b0e267-d7e0-4043-b34e-eec2dc4c5a6b/ffff8df681ad5800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113987 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789127282.867525:0:6686:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789127282.867677:0:6686:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789127282.867692:0:6686:0:(import.c:65:import_set_state_nolock()) ffff8df681ad5000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789127282.867715:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae959680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:81b0e267-d7e0-4043-b34e-eec2dc4c5a6b+6:2345:x1876035733827072:12345-192.168.206.40@tcp:8:mount.lustre.0 Request processed in 243us (1030us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127282.867722:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 13 00000100:00100000:3.0:1789127282.868561:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733827200 00000100:00100000:3.0:1789127282.868570:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733827200 00000100:00100000:3.0:1789127282.868617:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 1 00000100:00100000:3.0:1789127282.868625:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bfc49a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:81b0e267-d7e0-4043-b34e-eec2dc4c5a6b+6:8114:x1876035733827200:12345-192.168.206.40@tcp:33:mount.lustre.0 00000004:00200000:3.0:1789127282.868867:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1789127282.869013:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bfc49a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:81b0e267-d7e0-4043-b34e-eec2dc4c5a6b+6:8114:x1876035733827200:12345-192.168.206.40@tcp:33:mount.lustre.0 Request processed in 387us (2459us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127282.869022:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 1 00010000:00010000:0.0:1789127283.123467:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127283.187058:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789127283.187084:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae958780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1876035752733952:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789127283.187174:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127283.187380:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752733952 00000100:00100000:1.0:1789127283.187389:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752733952 00000100:00100000:1.0:1789127283.187437:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789127283.187448:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79062c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876035752733952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789127283.187471:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789127283.187526:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79062c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876035752733952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127283.187533:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:2.0:1789127283.187845:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df7ae958780 x1876035752733952/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127299 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127283.187862:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae958780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1876035752733952:0@lo:13:osp-pre-0-0.0 00000001:00100000:3.0:1789127283.285665:0:6714:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 81b0e267-d7e0-4043-b34e-eec2dc4c5a6b 00010000:00010000:2.0:1789127284.148902:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127285.174988:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127286.196389:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789127286.318104:0:5852:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 81b0e267-d7e0-4043-b34e-eec2dc4c5a6b 00000001:00100000:1.0:1789127286.356084:0:7646:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 81b0e267-d7e0-4043-b34e-eec2dc4c5a6b 00010000:00010000:2.0:1789127287.220703:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127287.283213:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7b4317480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1876035752734336:0@lo:400:kworker.0 00000100:00100000:3.0:1789127287.283291:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127287.283355:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789127287.283361:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7b4314f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876035752734208:0@lo:400:kworker.0 00000100:00100000:3.0:1789127287.283387:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127287.283404:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7b4315e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1876035752734720:0@lo:400:kworker.0 00000100:00100000:3.0:1789127287.283429:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127287.283464:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752734336 00000100:00100000:3.0:1789127287.283470:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752734336 00000100:00100000:3.0:1789127287.283513:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752734208 00000100:00100000:3.0:1789127287.283516:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752734208 00000100:00100000:3.0:1789127287.283548:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789127287.283556:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b4315a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876035752734336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127287.283606:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b4315a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876035752734336:12345-0@lo:400:kworker.0 Request processed in 50us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127287.283613:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:1.0:1789127287.283626:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789127287.283630:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789127287.283635:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b4314000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876035752734208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127287.283666:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789127287.283675:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae95ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752734848:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789127287.283703:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127287.283730:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752734848 00000100:00100000:1.0:1789127287.283740:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752734848 00000100:00100000:1.0:1789127287.283773:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789127287.283780:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae95b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876035752734848:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789127287.284040:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7b4317c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3301:1876035752734080:0@lo:400:kworker.0 00000100:00100000:2.0:1789127287.284076:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127287.284101:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7b43152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1876035752734592:0@lo:400:kworker.0 00000100:00100000:2.0:1789127287.284123:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127287.284136:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789127287.284141:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7b43161c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1876035752734464:0@lo:400:kworker.0 00000100:00100000:2.0:1789127287.284163:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127287.284200:0:5830:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1789127287.284208:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1789127287.284223:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752734720 00000100:00100000:2.0:1789127287.284228:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752734720 00000100:00100000:2.0:1789127287.284252:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752734464 00000100:00100000:2.0:1789127287.284263:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752734464 00000100:00100000:2.0:1789127287.284355:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789127287.284364:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b43170c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3303:x1876035752734720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127287.284399:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b43170c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3303:x1876035752734720:12345-0@lo:400:kworker.0 Request processed in 38us (969us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127287.284406:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789127287.284419:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789127287.284425:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79062c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1876035752734464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127287.284457:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79062c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1876035752734464:12345-0@lo:400:kworker.0 Request processed in 32us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127287.284463:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:2.0:1789127287.284565:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df7b43161c0 x1876035752734464/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127303 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127287.284579:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7b43161c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1876035752734464:0@lo:400:kworker.0 00002000:00000024:1.0:1789127287.284602:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789127287.284612:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752734592 00000100:00100000:2.0:1789127287.284615:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752734592 00000100:00100000:2.0:1789127287.284633:0:5830:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1789127287.284640:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789127287.284641:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae95b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876035752734848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 861us (936us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127287.284645:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79062c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876035752734592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127287.284648:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789127287.284671:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752734080 00000100:00100000:1.0:1789127287.284674:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752734080 00000100:00100000:1.0:1789127287.284699:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1789127287.284705:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7906c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:3301:x1876035752734080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127287.284742:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7906c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:3301:x1876035752734080:12345-0@lo:400:kworker.0 Request processed in 37us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127287.284749:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1789127287.284807:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7b4317c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3301:1876035752734080:0@lo:400:kworker.0 00000100:00100000:3.0:1789127287.285045:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b4314000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876035752734208:12345-0@lo:400:kworker.0 Request processed in 1409us (1655us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127287.285053:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789127287.285092:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7b4314f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876035752734208:0@lo:400:kworker.0 00010000:00080000:3.0:1789127287.285103:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df7b4315e00 x1876035752734720/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127303 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127287.285112:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7b4315e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1876035752734720:0@lo:400:kworker.0 00000100:00100000:3.0:1789127287.285123:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7b4317480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1876035752734336:0@lo:400:kworker.0 00000100:00080000:0.0:1789127287.285419:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789127287.285423:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789127287.285426:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789127287.285451:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df7ae95ad00 x1876035752734848/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127303 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127287.285466:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae95ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752734848:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789127287.286015:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79062c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876035752734592:12345-0@lo:400:kworker.0 Request processed in 1367us (1888us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127287.286023:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789127287.286097:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7b43152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1876035752734592:0@lo:400:kworker.0 00000100:00100000:2.0:1789127288.041517:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127288.041569:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127288.041605:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127288.041629:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127288.041664:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127288.041691:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733827328 00000100:00100000:2.0:1789127288.041699:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733827328 00000100:00100000:2.0:1789127288.041745:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 224 00000100:00100000:2.0:1789127288.041754:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7906ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d829a69b-d740-4e4c-8301-ef09c9d45165+13:2348:x1876035733827328:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:2.0:1789127288.041848:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7906ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d829a69b-d740-4e4c-8301-ef09c9d45165+13:2348:x1876035733827328:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 95us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127288.041857:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 224 00000100:00100000:2.0:1789127288.041887:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733827456 00000100:00100000:2.0:1789127288.041891:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733827456 00000100:00100000:2.0:1789127288.041921:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733827584 00000100:00100000:2.0:1789127288.041923:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733827584 00000100:00100000:2.0:1789127288.041941:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 69 00000100:00100000:2.0:1789127288.041947:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79062da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+6:2348:x1876035733827456:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:2.0:1789127288.041976:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79062da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+6:2348:x1876035733827456:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 29us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127288.041982:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 69 00000100:00100000:2.0:1789127288.041994:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 70 00000100:00100000:2.0:1789127288.042000:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6811c43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81b0e267-d7e0-4043-b34e-eec2dc4c5a6b+5:2348:x1876035733827584:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:2.0:1789127288.042019:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6811c43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81b0e267-d7e0-4043-b34e-eec2dc4c5a6b+5:2348:x1876035733827584:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 20us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127288.042025:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 70 00000100:00100000:2.0:1789127288.042040:0:8063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733827712 00000100:00100000:2.0:1789127288.042044:0:8063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733827712 00000100:00100000:2.0:1789127288.042066:0:8063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733827840 00000100:00100000:2.0:1789127288.042069:0:8063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733827840 00000100:00100000:2.0:1789127288.042088:0:8063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 32 00000100:00100000:2.0:1789127288.042101:0:8063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79062d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:81b0e267-d7e0-4043-b34e-eec2dc4c5a6b+5:2348:x1876035733827712:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:2.0:1789127288.042127:0:8063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79062d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:81b0e267-d7e0-4043-b34e-eec2dc4c5a6b+5:2348:x1876035733827712:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 27us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127288.042133:0:8063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 32 00000100:00100000:2.0:1789127288.042144:0:8063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 33 00000100:00100000:2.0:1789127288.042150:0:8063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeae5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:81b0e267-d7e0-4043-b34e-eec2dc4c5a6b+5:2348:x1876035733827840:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:2.0:1789127288.042183:0:8063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeae5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:81b0e267-d7e0-4043-b34e-eec2dc4c5a6b+5:2348:x1876035733827840:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 32us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127288.042189:0:8063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 33 00000100:00080000:2.0:1789127288.042323:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789127288.042328:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789127288.042330:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:3.0:1789127288.062923:0:10321:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg640-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:0.0:1789127288.243636:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127288.307015:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789127288.307039:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae95bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1876035752734976:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789127288.307122:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127288.307142:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752734976 00000100:00100000:1.0:1789127288.307150:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752734976 00000100:00100000:1.0:1789127288.307205:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789127288.307212:0:6690:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:1.0:1789127288.307215:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeae52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876035752734976:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789127288.307219:0:6690:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:1.0:1789127288.307249:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789127288.307295:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeae52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876035752734976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127288.307301:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:1.0:1789127288.307339:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df7ae95bc00 x1876035752734976/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127304 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127288.307373:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae95bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1876035752734976:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789127289.273431:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127290.291004:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127291.317339:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127292.339338:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127292.403783:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7bbd870c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3301:1876035752735104:0@lo:400:kworker.0 00000100:00100000:0.0:1789127292.403783:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7bbd87c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876035752735232:0@lo:400:kworker.0 00000100:00100000:1.0:1789127292.403951:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7bbd84f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1876035752735360:0@lo:400:kworker.0 00000100:00100000:3.0:1789127292.404244:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7bbd87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1876035752735488:0@lo:400:kworker.0 00000100:00100000:0.0:1789127292.406414:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127292.406499:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7bbd852c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752735744:0@lo:400:kworker.0 00000100:00100000:2.0:1789127292.406511:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127292.406538:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127292.406545:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7bbd861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1876035752735616:0@lo:400:kworker.0 00000100:00100000:2.0:1789127292.406569:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127292.406608:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752735232 00000100:00100000:2.0:1789127292.406616:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752735232 00000100:00100000:1.0:1789127292.406746:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127292.406769:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae958f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1876035752735872:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789127292.407090:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752735616 00000100:00100000:2.0:1789127292.407096:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752735616 00000100:00100000:2.0:1789127292.407155:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752735360 00000100:00100000:2.0:1789127292.407159:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752735360 00000100:00100000:2.0:1789127292.407181:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789127292.407190:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bbd85e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876035752735232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127292.407261:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bbd85e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876035752735232:12345-0@lo:400:kworker.0 Request processed in 71us (856us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127292.407269:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789127292.407287:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789127292.407292:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79062e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876035752735616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127292.407313:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127292.407321:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79062e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876035752735616:12345-0@lo:400:kworker.0 Request processed in 29us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127292.407326:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789127292.407336:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789127292.407342:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae95b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876035752735360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127292.407371:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae95b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876035752735360:12345-0@lo:400:kworker.0 Request processed in 30us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127292.407376:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789127292.407396:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752735104 00000100:00100000:2.0:1789127292.407400:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752735104 00000100:00100000:2.0:1789127292.407423:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1789127292.407429:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7906c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:3301:x1876035752735104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127292.407458:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7906c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:3301:x1876035752735104:12345-0@lo:400:kworker.0 Request processed in 29us (946us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127292.407463:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1789127292.407492:0:8063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752735744 00000100:00100000:2.0:1789127292.407495:0:8063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752735744 00000100:00100000:2.0:1789127292.407522:0:8063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752735488 00000100:00100000:2.0:1789127292.407532:0:8063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752735488 00000100:00100000:2.0:1789127292.407557:0:8063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789127292.407563:0:8063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bbd85a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1876035752735744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127292.407594:0:8063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bbd85a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1876035752735744:12345-0@lo:400:kworker.0 Request processed in 33us (1056us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127292.407600:0:8063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789127292.407611:0:8063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789127292.407615:0:8063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b4316d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1876035752735488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127292.407645:0:8063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b4316d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1876035752735488:12345-0@lo:400:kworker.0 Request processed in 29us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127292.407651:0:8063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:2.0:1789127292.407670:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789127292.407674:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789127292.407677:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789127292.407719:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df7bbd87480 x1876035752735488/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127308 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127292.407734:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7bbd87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1876035752735488:0@lo:400:kworker.0 00000100:00100000:2.0:1789127292.407807:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7bbd87c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876035752735232:0@lo:400:kworker.0 00010000:00080000:2.0:1789127292.407821:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df7bbd852c0 x1876035752735744/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127308 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127292.407831:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7bbd852c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752735744:0@lo:400:kworker.0 00000100:00100000:2.0:1789127292.407860:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7bbd870c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3301:1876035752735104:0@lo:400:kworker.0 00000100:00100000:2.0:1789127292.407873:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7bbd861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1876035752735616:0@lo:400:kworker.0 00000100:00100000:1.0:1789127292.408745:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127292.409066:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7bbd84f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1876035752735360:0@lo:400:kworker.0 00000100:00100000:1.0:1789127292.411646:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752735872 00000100:00100000:1.0:1789127292.411664:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752735872 00000100:00100000:1.0:1789127292.411822:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789127292.411835:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae95a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876035752735872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789127292.411904:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789127292.412007:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae95a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876035752735872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 174us (3265us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127292.412016:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:3.0:1789127292.412482:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df7ae958f00 x1876035752735872/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127308 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127292.412511:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae958f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1876035752735872:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789127293.163892:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127293.163938:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733828096 00000100:00100000:0.0:1789127293.163938:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127293.163951:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733828096 00000100:00100000:0.0:1789127293.163983:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127293.164012:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127293.164041:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127293.164048:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733828224 00000100:00100000:1.0:1789127293.164053:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733828224 00000100:00100000:0.0:1789127293.164082:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733827968 00000100:00100000:0.0:1789127293.164087:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733827968 00000100:00100000:1.0:1789127293.164105:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 74 00000100:00100000:0.0:1789127293.164128:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 226 00000100:00100000:1.0:1789127293.164130:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bbd86d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+6:2349:x1876035733828096:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:0.0:1789127293.164152:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7906cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d829a69b-d740-4e4c-8301-ef09c9d45165+13:2349:x1876035733827968:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:0.0:1789127293.164237:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7906cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d829a69b-d740-4e4c-8301-ef09c9d45165+13:2349:x1876035733827968:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 100us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127293.164246:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 226 00000100:00100000:3.0:1789127293.164282:0:8063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733828352 00000100:00100000:3.0:1789127293.164287:0:8063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733828352 00000100:00100000:0.0:1789127293.164292:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 75 00000100:00100000:0.0:1789127293.164303:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bbd861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81b0e267-d7e0-4043-b34e-eec2dc4c5a6b+5:2349:x1876035733828224:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:3.0:1789127293.164328:0:8063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733828480 00000100:00100000:3.0:1789127293.164344:0:8063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733828480 00000100:00100000:3.0:1789127293.164375:0:8063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 36 00000100:00100000:3.0:1789127293.164383:0:8063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bbd84f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:81b0e267-d7e0-4043-b34e-eec2dc4c5a6b+5:2349:x1876035733828352:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:1.0:1789127293.168148:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bbd86d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+6:2349:x1876035733828096:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 3997us (4243us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127293.168167:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 74 00000100:00080000:1.0:1789127293.168228:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789127293.168248:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789127293.168252:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789127293.168315:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 37 00000100:00100000:1.0:1789127293.168331:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bbd870c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:81b0e267-d7e0-4043-b34e-eec2dc4c5a6b+5:2349:x1876035733828480:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:1.0:1789127293.168394:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bbd870c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:81b0e267-d7e0-4043-b34e-eec2dc4c5a6b+5:2349:x1876035733828480:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 70us (4352us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127293.168401:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 37 00000100:00100000:3.0:1789127293.175677:0:8063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bbd84f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:81b0e267-d7e0-4043-b34e-eec2dc4c5a6b+5:2349:x1876035733828352:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 11289us (11733us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127293.175696:0:8063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 36 00000100:00100000:0.0:1789127293.175954:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bbd861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81b0e267-d7e0-4043-b34e-eec2dc4c5a6b+5:2349:x1876035733828224:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 11198us (11486us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127293.175969:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 75 00010000:00010000:2.0:1789127293.363154:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127293.427225:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae9592c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1876035752736000:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789127293.427325:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127293.427441:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752736000 00000100:00100000:2.0:1789127293.427450:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752736000 00000100:00100000:2.0:1789127293.427508:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789127293.427518:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7af7cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876035752736000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789127293.427564:0:10333:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789127293.427616:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7af7cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876035752736000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127293.427624:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:2.0:1789127293.427675:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df7ae9592c0 x1876035752736000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127309 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127293.427696:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae9592c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1876035752736000:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789127294.389016:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127295.415492:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127296.436500:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127297.459549:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127297.523202:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae958000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1876035752736128:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789127297.523301:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127297.523470:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752736128 00000100:00100000:3.0:1789127297.523481:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752736128 00000100:00100000:3.0:1789127297.523565:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789127297.523587:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bbd87c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876035752736128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789127297.523633:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1789127297.523704:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789127297.533956:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a385a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3302:1876035752736256:0@lo:400:kworker.0 00000100:00100000:0.0:1789127297.534074:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127297.534399:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752736256 00000100:00100000:0.0:1789127297.534409:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752736256 00000100:00100000:0.0:1789127297.534717:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1789127297.534747:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7906ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:3302:x1876035752736256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127297.534774:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bbd87c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876035752736128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 11187us (11469us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127297.534798:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789127297.534842:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7906ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:3302:x1876035752736256:12345-0@lo:400:kworker.0 Request processed in 98us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127297.534850:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1789127297.535031:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a385a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3302:1876035752736256:0@lo:400:kworker.0 00000100:00100000:2.0:1789127297.535284:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789127297.535359:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7bbd87840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1876035752736768:0@lo:400:kworker.0 00000100:00100000:2.0:1789127297.535404:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127297.535614:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7bbd84b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1876035752736512:0@lo:400:kworker.0 00000100:00100000:0.0:1789127297.535644:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127297.535670:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789127297.535675:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7bbd84780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1876035752736640:0@lo:400:kworker.0 00000100:00100000:0.0:1789127297.535703:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127297.535730:0:10285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752736768 00000100:00100000:0.0:1789127297.535736:0:10285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752736768 00000100:00100000:3.0:1789127297.535844:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752736512 00000100:00100000:3.0:1789127297.535848:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752736512 00000100:00100000:2.0:1789127297.535851:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7bbd87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876035752736384:0@lo:400:kworker.0 00000100:00100000:2.0:1789127297.535883:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127297.536036:0:10285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752736384 00000100:00100000:0.0:1789127297.536040:0:10285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752736384 00000100:00100000:0.0:1789127297.536279:0:10285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789127297.536292:0:10285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79a384780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876035752736768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127297.536347:0:10285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79a384780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876035752736768:12345-0@lo:400:kworker.0 Request processed in 57us (942us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127297.536381:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789127297.536392:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79a385e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876035752736384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127297.536426:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79a385e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876035752736384:12345-0@lo:400:kworker.0 Request processed in 37us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127297.536445:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00080000:1.0:1789127297.536492:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df7ae958000 x1876035752736128/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127313 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127297.536517:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae958000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1876035752736128:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789127297.536836:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752736640 00000100:00100000:1.0:1789127297.536841:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752736640 00000100:00100000:2.0:1789127297.536850:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7bbd87840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1876035752736768:0@lo:400:kworker.0 00000100:00100000:2.0:1789127297.536885:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7bbd87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876035752736384:0@lo:400:kworker.0 00000100:00100000:0.0:1789127297.539941:0:10285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789127297.541910:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789127297.541929:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bbd86940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876035752736512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127297.543656:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bbd86940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876035752736512:12345-0@lo:400:kworker.0 Request processed in 1722us (7998us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127297.543672:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789127297.543722:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7bbd84b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1876035752736512:0@lo:400:kworker.0 00000100:00080000:0.0:1789127297.544250:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789127297.544259:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789127297.545074:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789127297.545094:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bbd84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1876035752736640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127297.545217:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bbd84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1876035752736640:12345-0@lo:400:kworker.0 Request processed in 131us (9512us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127297.545225:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:0.0:1789127297.545300:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df7bbd84780 x1876035752736640/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127313 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127297.545317:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7bbd84780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1876035752736640:0@lo:400:kworker.0 00000100:00100000:0.0:1789127298.282643:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127298.282697:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127298.282920:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127298.282944:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127298.282972:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127298.283030:0:10285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733828736 00000100:00100000:1.0:1789127298.283042:0:10285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733828736 00000100:00100000:3.0:1789127298.283044:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733828608 00000100:00100000:3.0:1789127298.283048:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733828608 00000100:00100000:1.0:1789127298.283093:0:10285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733828864 00000100:00100000:1.0:1789127298.283096:0:10285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733828864 00000100:00100000:3.0:1789127298.283105:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 228 00000100:00100000:1.0:1789127298.283129:0:10285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 79 00000100:00100000:1.0:1789127298.283140:0:10285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bbd84780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+6:2348:x1876035733828736:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:3.0:1789127298.283205:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7906cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d829a69b-d740-4e4c-8301-ef09c9d45165+13:2348:x1876035733828608:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:3.0:1789127298.283243:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7906cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d829a69b-d740-4e4c-8301-ef09c9d45165+13:2348:x1876035733828608:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 41us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127298.283243:0:10285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bbd84780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+6:2348:x1876035733828736:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 106us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127298.283258:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 228 00000100:00100000:1.0:1789127298.283258:0:10285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 79 00000100:00100000:1.0:1789127298.283277:0:10285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 80 00000100:00100000:1.0:1789127298.283282:0:10285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bbd87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81b0e267-d7e0-4043-b34e-eec2dc4c5a6b+5:2348:x1876035733828864:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:1.0:1789127298.283308:0:10285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bbd87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81b0e267-d7e0-4043-b34e-eec2dc4c5a6b+5:2348:x1876035733828864:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 26us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127298.283314:0:10285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 80 00000100:00080000:1.0:1789127298.283330:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789127298.293209:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733828992 00000100:00100000:2.0:1789127298.293228:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733828992 00000100:00080000:2.0:1789127298.293382:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789127298.293442:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733829120 00000100:00100000:2.0:1789127298.293447:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733829120 00000100:00100000:2.0:1789127298.293484:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 39 00000100:00100000:2.0:1789127298.293494:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bbd84b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:81b0e267-d7e0-4043-b34e-eec2dc4c5a6b+5:2348:x1876035733828992:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:2.0:1789127298.293590:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bbd84b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:81b0e267-d7e0-4043-b34e-eec2dc4c5a6b+5:2348:x1876035733828992:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 98us (10891us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127298.293598:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 39 00000100:00100000:2.0:1789127298.293616:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 40 00000100:00100000:2.0:1789127298.293623:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bbd87840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:81b0e267-d7e0-4043-b34e-eec2dc4c5a6b+5:2348:x1876035733829120:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:2.0:1789127298.293644:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bbd87840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:81b0e267-d7e0-4043-b34e-eec2dc4c5a6b+5:2348:x1876035733829120:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 23us (10672us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127298.293732:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 40 00000100:00080000:2.0:1789127298.293751:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789127298.484592:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127298.550431:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a387480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1876035752736896:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789127298.550530:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127298.550645:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752736896 00000100:00100000:2.0:1789127298.550655:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752736896 00000100:00100000:2.0:1789127298.550714:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789127298.550725:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae9583c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876035752736896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789127298.550768:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789127298.552271:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae9583c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876035752736896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1539us (1732us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127298.552310:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:1.0:1789127298.552564:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df79a387480 x1876035752736896/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127314 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127298.552593:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a387480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1876035752736896:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789127299.507004:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127300.531022:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127301.561073:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127302.583933:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127302.644575:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae958000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876035752737152:0@lo:400:kworker.0 00000100:00100000:1.0:1789127302.644640:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127302.644687:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae958f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1876035752737664:0@lo:400:kworker.0 00000100:00100000:1.0:1789127302.644707:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127302.644737:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789127302.644743:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae95a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3301:1876035752737024:0@lo:400:kworker.0 00000100:00100000:1.0:1789127302.644767:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127302.644784:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae9592c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1876035752737536:0@lo:400:kworker.0 00000100:00100000:1.0:1789127302.644834:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127302.644844:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752737024 00000100:00100000:0.0:1789127302.644853:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752737024 00000100:00100000:1.0:1789127302.644862:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae959a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1876035752737280:0@lo:400:kworker.0 00000100:00100000:1.0:1789127302.644885:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127302.644913:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789127302.644915:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1789127302.644920:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae959e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752737408:0@lo:400:kworker.0 00000100:00100000:0.0:1789127302.644929:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7906c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:3301:x1876035752737024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127302.644947:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127302.644975:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752737152 00000100:00100000:1.0:1789127302.644979:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752737152 00000100:00100000:0.0:1789127302.644991:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7906c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:3301:x1876035752737024:12345-0@lo:400:kworker.0 Request processed in 65us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127302.645010:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752737536 00000100:00100000:1.0:1789127302.645015:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752737536 00000100:00100000:0.0:1789127302.645019:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1789127302.645040:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752737280 00000100:00100000:1.0:1789127302.645044:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752737280 00000100:00100000:1.0:1789127302.645063:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789127302.645071:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae95bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876035752737152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127302.645085:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae95a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3301:1876035752737024:0@lo:400:kworker.0 00000100:00100000:1.0:1789127302.645123:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae95bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876035752737152:12345-0@lo:400:kworker.0 Request processed in 52us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127302.645127:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae958000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876035752737152:0@lo:400:kworker.0 00000100:00100000:1.0:1789127302.645134:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789127302.645151:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789127302.645157:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae958b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876035752737536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127302.645191:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae958b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876035752737536:12345-0@lo:400:kworker.0 Request processed in 35us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127302.645197:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789127302.645206:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789127302.645212:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae95b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876035752737280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127302.645245:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae9592c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1876035752737536:0@lo:400:kworker.0 00000100:00100000:1.0:1789127302.645432:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae95b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876035752737280:12345-0@lo:400:kworker.0 Request processed in 220us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127302.645438:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789127302.645455:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752737664 00000100:00100000:1.0:1789127302.645458:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752737664 00000100:00100000:1.0:1789127302.645487:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752737408 00000100:00100000:1.0:1789127302.645490:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752737408 00000100:00100000:1.0:1789127302.645528:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789127302.645534:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae95ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1876035752737664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127302.645568:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae95ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1876035752737664:12345-0@lo:400:kworker.0 Request processed in 35us (860us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127302.645573:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789127302.645584:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789127302.645589:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df788017050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1876035752737408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127302.645615:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df788017050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1876035752737408:12345-0@lo:400:kworker.0 Request processed in 26us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127302.645620:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:0.0:1789127302.645630:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df7ae958f00 x1876035752737664/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127318 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127302.645643:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae958f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1876035752737664:0@lo:400:kworker.0 00000100:00080000:1.0:1789127302.645784:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789127302.646903:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789127302.646908:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789127302.646921:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789127302.646937:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7b43152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1876035752737792:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789127302.646984:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789127302.647099:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df7ae959e00 x1876035752737408/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127318 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127302.647112:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae959e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752737408:0@lo:400:kworker.0 00000100:00100000:1.0:1789127302.647126:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae959a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1876035752737280:0@lo:400:kworker.0 00000100:00100000:3.0:1789127302.657187:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752737792 00000100:00100000:3.0:1789127302.657201:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752737792 00000100:00100000:3.0:1789127302.657257:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789127302.657265:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae959680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876035752737792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789127302.657300:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789127302.657395:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae959680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876035752737792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 129us (10409us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127302.657403:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:1.0:1789127302.657532:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df7b43152c0 x1876035752737792/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127318 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127302.657552:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7b43152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1876035752737792:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789127303.411040:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127303.411107:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127303.411139:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127303.411171:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127303.411198:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127303.411213:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733829632 00000100:00100000:2.0:1789127303.411216:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733829760 00000100:00100000:2.0:1789127303.411222:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733829760 00000100:00100000:0.0:1789127303.411222:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733829632 00000100:00100000:2.0:1789127303.411275:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 14 00000100:00100000:2.0:1789127303.411285:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79a385a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:81b0e267-d7e0-4043-b34e-eec2dc4c5a6b+5:2345:x1876035733829760:12345-192.168.206.40@tcp:9:kworker.0 00000020:00000080:2.0:1789127303.411314:0:6686:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xeeacf7c0243004b2 00000100:00080000:2.0:1789127303.411323:0:6686:0:(import.c:65:import_set_state_nolock()) ffff8df681ad5000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789127303.411362:0:6686:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1789127303.411691:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79a385a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:81b0e267-d7e0-4043-b34e-eec2dc4c5a6b+2:2345:x1876035733829760:12345-192.168.206.40@tcp:9:kworker.0 Request processed in 406us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127303.411699:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 14 00000100:00100000:2.0:1789127303.411726:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733829248 00000100:00100000:2.0:1789127303.411729:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733829248 00000100:00100000:2.0:1789127303.411755:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 230 00000100:00100000:2.0:1789127303.411761:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7906cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d829a69b-d740-4e4c-8301-ef09c9d45165+13:2346:x1876035733829248:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:2.0:1789127303.411785:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7906cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d829a69b-d740-4e4c-8301-ef09c9d45165+13:2346:x1876035733829248:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 25us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127303.411808:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 230 00000100:00100000:2.0:1789127303.411835:0:10285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733829376 00000100:00100000:2.0:1789127303.411851:0:10285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733829376 00000100:00100000:3.0:1789127303.411901:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733829504 00000100:00100000:3.0:1789127303.411904:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733829504 00000100:00100000:0.0:1789127303.413324:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 15 00000100:00100000:0.0:1789127303.413338:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79a3852c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:81b0e267-d7e0-4043-b34e-eec2dc4c5a6b+5:2345:x1876035733829632:12345-192.168.206.40@tcp:9:kworker.0 00000020:00000080:0.0:1789127303.413363:0:6689:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xeeacf7c0243004ab 00000100:00080000:0.0:1789127303.413372:0:6689:0:(import.c:65:import_set_state_nolock()) ffff8df681ad0000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789127303.413404:0:6689:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1789127303.413708:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79a3852c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:81b0e267-d7e0-4043-b34e-eec2dc4c5a6b+2:2345:x1876035733829632:12345-192.168.206.40@tcp:9:kworker.0 Request processed in 373us (2600us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127303.413724:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 15 00010000:00010000:0.0:1789127303.413750:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127303.416004:0:10285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 84 00000100:00100000:2.0:1789127303.416022:0:10285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79a3861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+6:2346:x1876035733829376:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:2.0:1789127303.416113:0:10285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79a3861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+6:2346:x1876035733829376:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 98us (5081us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127303.416120:0:10285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 84 00000100:00080000:2.0:1789127303.416151:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789127303.416156:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789127303.416158:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789127303.416172:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127303.420094:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 85 00000100:00100000:3.0:1789127303.420109:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df682c703c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81b0e267-d7e0-4043-b34e-eec2dc4c5a6b+5:2346:x1876035733829504:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:3.0:1789127303.420202:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df682c703c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81b0e267-d7e0-4043-b34e-eec2dc4c5a6b+5:2346:x1876035733829504:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 96us (9002us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127303.420209:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 85 00010000:00010000:2.0:1789127303.606667:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127303.667931:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789127303.667953:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7bbd85680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752737920:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789127303.668020:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127303.670772:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752737920 00000100:00100000:3.0:1789127303.670783:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752737920 00000100:00100000:3.0:1789127303.670860:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789127303.670869:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bbd85a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876035752737920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789127303.670901:0:10333:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789127303.670976:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bbd85a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876035752737920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (2955us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127303.670983:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:3.0:1789127303.671041:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df7bbd85680 x1876035752737920/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127319 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127303.671060:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7bbd85680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752737920:0@lo:13:osp-pre-0-0.0 00000001:00100000:2.0:1789127303.735131:0:6714:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 81b0e267-d7e0-4043-b34e-eec2dc4c5a6b 00000020:00000080:2.0:1789127303.735140:0:6714:0:(genops.c:885:class_export_put()) final put ffff8df681ad7000/81b0e267-d7e0-4043-b34e-eec2dc4c5a6b 00000020:00000080:2.0:1789127303.735166:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df681ad7000/81b0e267-d7e0-4043-b34e-eec2dc4c5a6b for lustre-OST0000 00000020:00000080:2.0:1789127303.735207:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df681ad0000 for lustre-OST0000 00010000:00010000:0.0:1789127304.628057:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127305.650928:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789127306.667994:0:11023:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1789127306.674921:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789127306.824966:0:7646:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 81b0e267-d7e0-4043-b34e-eec2dc4c5a6b 00000020:00000080:2.0:1789127306.824976:0:7646:0:(genops.c:885:class_export_put()) final put ffff8df681ad5800/81b0e267-d7e0-4043-b34e-eec2dc4c5a6b 00000020:00000080:3.0:1789127306.825491:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8df681ad5800/81b0e267-d7e0-4043-b34e-eec2dc4c5a6b for lustre-OST0001 00000020:00000080:3.0:1789127306.825539:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df681ad5000 for lustre-OST0001 00010000:00010000:2.0:1789127307.700853:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127307.763027:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae959e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1876035752738432:0@lo:400:kworker.0 00000100:00100000:1.0:1789127307.763105:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127307.763175:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789127307.763182:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae958780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1876035752738304:0@lo:400:kworker.0 00000100:00100000:1.0:1789127307.763211:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127307.763266:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752738432 00000100:00100000:1.0:1789127307.763272:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752738432 00000100:00100000:1.0:1789127307.763334:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789127307.763343:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae9592c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1876035752738432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127307.763405:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae9592c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1876035752738432:12345-0@lo:400:kworker.0 Request processed in 64us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127307.763413:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789127307.763436:0:10285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752738304 00000100:00100000:1.0:1789127307.763439:0:10285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752738304 00000100:00100000:1.0:1789127307.763465:0:10285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789127307.763472:0:10285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae958000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876035752738304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127307.763503:0:10285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae958000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876035752738304:12345-0@lo:400:kworker.0 Request processed in 31us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127307.763510:0:10285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:1.0:1789127307.763592:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789127307.763596:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789127307.763622:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae958780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1876035752738304:0@lo:400:kworker.0 00010000:00080000:1.0:1789127307.763636:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df7ae959e00 x1876035752738432/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127323 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127307.763646:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae959e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1876035752738432:0@lo:400:kworker.0 00000100:00100000:0.0:1789127307.764218:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae95ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3300:1876035752738048:0@lo:400:kworker.0 00000100:00100000:0.0:1789127307.764275:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127307.764322:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae959a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1876035752738560:0@lo:400:kworker.0 00000100:00100000:0.0:1789127307.764347:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127307.764371:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789127307.764376:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae95a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876035752738176:0@lo:400:kworker.0 00000100:00100000:0.0:1789127307.764399:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127307.764416:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae958f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1876035752738688:0@lo:400:kworker.0 00000100:00100000:0.0:1789127307.764439:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127307.764471:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752738688 00000100:00100000:0.0:1789127307.764476:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752738688 00000100:00100000:0.0:1789127307.764517:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789127307.764524:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bbd87840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1876035752738688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127307.764564:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bbd87840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1876035752738688:12345-0@lo:400:kworker.0 Request processed in 40us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127307.764570:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789127307.764587:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752738560 00000100:00100000:0.0:1789127307.764590:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752738560 00000100:00100000:0.0:1789127307.764612:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752738176 00000100:00100000:0.0:1789127307.764615:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752738176 00000100:00100000:0.0:1789127307.764640:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789127307.764646:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bbd84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876035752738560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127307.764675:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bbd84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876035752738560:12345-0@lo:400:kworker.0 Request processed in 29us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127307.764681:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789127307.764690:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789127307.764696:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bbd84b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876035752738176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127307.764717:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bbd84b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876035752738176:12345-0@lo:400:kworker.0 Request processed in 22us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127307.764722:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:0.0:1789127307.764745:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789127307.764748:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789127307.764769:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae95a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876035752738176:0@lo:400:kworker.0 00010000:00080000:0.0:1789127307.764779:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df7ae958f00 x1876035752738688/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127323 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127307.764826:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae958f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1876035752738688:0@lo:400:kworker.0 00000100:00100000:0.0:1789127307.764837:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae959a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1876035752738560:0@lo:400:kworker.0 00000100:00100000:3.0:1789127307.765137:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7b43161c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752738816:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789127307.765169:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127307.765207:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752738816 00000100:00100000:3.0:1789127307.765211:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752738816 00000100:00100000:3.0:1789127307.765249:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789127307.765256:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b43152c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876035752738816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789127307.765282:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789127307.765330:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b43152c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876035752738816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127307.765337:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1789127307.765366:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df7b43161c0 x1876035752738816/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127323 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127307.765380:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7b43161c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752738816:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789127307.765592:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752738048 00000100:00100000:1.0:1789127307.765597:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752738048 00000100:00100000:1.0:1789127307.765640:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1789127307.765648:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7906c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:3300:x1876035752738048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127307.765702:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7906c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:3300:x1876035752738048:12345-0@lo:400:kworker.0 Request processed in 55us (1425us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127307.765709:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1789127307.766035:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae95ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3300:1876035752738048:0@lo:400:kworker.0 00000100:00100000:3.0:1789127308.521045:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127308.521093:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127308.521126:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127308.521150:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733830144 00000100:00100000:3.0:1789127308.521158:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733830144 00000100:00100000:3.0:1789127308.521207:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733830016 00000100:00100000:3.0:1789127308.521210:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733830016 00000100:00100000:3.0:1789127308.521240:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 89 00000100:00100000:3.0:1789127308.521248:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b4315680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81b0e267-d7e0-4043-b34e-eec2dc4c5a6b+5:2346:x1876035733830144:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:3.0:1789127308.521311:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b4315680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81b0e267-d7e0-4043-b34e-eec2dc4c5a6b+5:2346:x1876035733830144:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 64us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127308.521318:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 89 00000100:00100000:3.0:1789127308.521333:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 90 00000100:00100000:3.0:1789127308.521340:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b4314b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+6:2346:x1876035733830016:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:3.0:1789127308.521358:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b4314b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+6:2346:x1876035733830016:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 20us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127308.521364:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 90 00000100:00080000:3.0:1789127308.521380:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789127308.521498:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733829888 00000100:00100000:0.0:1789127308.521503:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733829888 00000100:00100000:0.0:1789127308.521534:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 232 00000100:00100000:0.0:1789127308.521542:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7906cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d829a69b-d740-4e4c-8301-ef09c9d45165+13:2346:x1876035733829888:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:0.0:1789127308.521571:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7906cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d829a69b-d740-4e4c-8301-ef09c9d45165+13:2346:x1876035733829888:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 30us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127308.521587:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 232 00010000:00010000:2.0:1789127308.722906:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127308.791034:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae959e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1876035752738944:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789127308.791114:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127308.791187:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752738944 00000100:00100000:3.0:1789127308.791194:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752738944 00000100:00100000:3.0:1789127308.791233:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789127308.791240:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b43170c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876035752738944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789127308.791273:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789127308.791313:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b43170c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876035752738944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127308.791320:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:3.0:1789127308.791358:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df7ae959e00 x1876035752738944/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127324 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127308.791376:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae959e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1876035752738944:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789127309.746897:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789127309.970689:0:11172:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffff9e43830 20000000:00000080:1.0:1789127309.970706:0:11172:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8df7889d0400 uarg=0000000000000000 20000000:01000000:1.0:1789127309.970738:0:11172:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789127309.970744:0:11172:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789127309.970748:0:11172:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1789127309.972288:0:11173:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1789127309.972445:0:11172:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1789127309.980213:0:11172:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789127309.980240:0:11172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8df7bbd96600/0xeeacf7c0243004b9 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127309.980260:0:11172:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df7ae728600/0xeeacf7c02430045e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7a01 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127309.980269:0:11172:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df798df1c00/0xeeacf7c02430046c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c024300465 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127309.980275:0:11172:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df798df1e00/0xeeacf7c02430047a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c024300473 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127309.980282:0:11172:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df79032de00/0xeeacf7c024300488 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c024300481 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127309.980288:0:11172:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df7ae729000/0xeeacf7c02430049d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7a39 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127309.980295:0:11172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8df7bbd96600/0xeeacf7c0243004b9 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127309.980351:0:11172:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df7ae729000/0xeeacf7c02430049d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7a39 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127309.980365:0:11172:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df7ae729000/0xeeacf7c02430049d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7a39 expref: 12 pid: 5825 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127309.980379:0:11172:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae958780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11172:1876035752739072:192.168.206.40@tcp:104: 00010000:00010000:1.0:1789127309.980556:0:11172:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df79032de00/0xeeacf7c024300488 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xeeacf7c024300481 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127309.980565:0:11172:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df79032de00/0xeeacf7c024300488 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xeeacf7c024300481 expref: 18 pid: 5824 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127309.980573:0:11172:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae95a940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11172:1876035752739200:0@lo:104: 00000100:00100000:1.0:1789127309.980611:0:11172:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789127309.980658:0:11172:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df798df1e00/0xeeacf7c02430047a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xeeacf7c024300473 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127309.980666:0:11172:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df798df1e00/0xeeacf7c02430047a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xeeacf7c024300473 expref: 18 pid: 5825 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127309.980674:0:11172:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae95ad00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11172:1876035752739328:0@lo:104: 00000100:00100000:1.0:1789127309.980699:0:11172:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789127309.980735:0:11172:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df798df1c00/0xeeacf7c02430046c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xeeacf7c024300465 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127309.980743:0:11172:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df798df1c00/0xeeacf7c02430046c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xeeacf7c024300465 expref: 18 pid: 5825 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127309.980776:0:11172:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae958f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11172:1876035752739456:0@lo:104: 00000100:00100000:1.0:1789127309.980944:0:11172:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789127309.980976:0:11172:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df7ae728600/0xeeacf7c02430045e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7a01 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127309.981038:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752739200 00000100:00100000:0.0:1789127309.981045:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752739200 00000100:00100000:0.0:1789127309.981092:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752739328 00000100:00100000:0.0:1789127309.981095:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752739328 00000100:00100000:0.0:1789127309.981105:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752739456 00000100:00100000:0.0:1789127309.981108:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752739456 00000100:00100000:0.0:1789127309.981119:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789127309.981127:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae959e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+5:11172:x1876035752739200:12345-0@lo:104: 00010000:00010000:0.0:1789127309.981148:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.140@tcp lock: ffff8df79032d200/0xeeacf7c024300481 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xeeacf7c024300488 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127309.981195:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789127309.981201:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae959e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+5:11172:x1876035752739200:12345-0@lo:104: Request processed in 75us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127309.981208:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789127309.981224:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789127309.981230:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae959a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+4:11172:x1876035752739328:12345-0@lo:104: 00010000:00010000:0.0:1789127309.981238:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.140@tcp lock: ffff8df798df0200/0xeeacf7c024300473 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xeeacf7c02430047a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127309.981271:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789127309.981275:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae959a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+4:11172:x1876035752739328:12345-0@lo:104: Request processed in 46us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127309.981281:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789127309.981292:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789127309.981298:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae95a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+3:11172:x1876035752739456:12345-0@lo:104: 00010000:00010000:0.0:1789127309.981313:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.140@tcp lock: ffff8df798df0800/0xeeacf7c024300465 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xeeacf7c02430046c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127309.981345:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789127309.981350:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae95a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+3:11172:x1876035752739456:12345-0@lo:104: Request processed in 52us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127309.981356:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1789127309.981377:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789127309.981382:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.140@tcp lock: ffff8df79032d200/0xeeacf7c024300481 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xeeacf7c024300488 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127309.981389:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df79032d200 already unused, calling callback (ffffffffc1da1c20) 10000000:00010000:0.0:1789127309.981393:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.140@tcp lock: ffff8df79032d200/0xeeacf7c024300481 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xeeacf7c024300488 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127309.981401:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: ffff8df79032d200/0xeeacf7c024300481 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xeeacf7c024300488 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789127309.981408:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: ffff8df79032d200/0xeeacf7c024300481 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xeeacf7c024300488 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127309.981414:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789127309.981440:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.140@tcp lock: ffff8df79032d200/0xeeacf7c024300481 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c024300488 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127309.981447:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789127309.981464:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.140@tcp lock: ffff8df79032d200/0xeeacf7c024300481 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c024300488 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127309.981470:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: ffff8df79032d200/0xeeacf7c024300481 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c024300488 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127309.981486:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789127309.981490:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.140@tcp lock: ffff8df798df0200/0xeeacf7c024300473 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xeeacf7c02430047a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127309.981496:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df798df0200 already unused, calling callback (ffffffffc1da1c20) 10000000:00010000:0.0:1789127309.981498:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.140@tcp lock: ffff8df798df0200/0xeeacf7c024300473 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xeeacf7c02430047a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127309.981505:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: ffff8df798df0200/0xeeacf7c024300473 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xeeacf7c02430047a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789127309.981511:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: ffff8df798df0200/0xeeacf7c024300473 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xeeacf7c02430047a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127309.981516:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789127309.981531:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.140@tcp lock: ffff8df798df0200/0xeeacf7c024300473 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c02430047a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127309.981537:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789127309.981543:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.140@tcp lock: ffff8df798df0200/0xeeacf7c024300473 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c02430047a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127309.981549:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: ffff8df798df0200/0xeeacf7c024300473 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c02430047a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127309.981561:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789127309.981563:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.140@tcp lock: ffff8df798df0800/0xeeacf7c024300465 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xeeacf7c02430046c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127309.981578:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df798df0800 already unused, calling callback (ffffffffc1da1c20) 10000000:00010000:0.0:1789127309.981581:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.140@tcp lock: ffff8df798df0800/0xeeacf7c024300465 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xeeacf7c02430046c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127309.981587:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: ffff8df798df0800/0xeeacf7c024300465 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xeeacf7c02430046c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789127309.981593:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: ffff8df798df0800/0xeeacf7c024300465 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xeeacf7c02430046c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127309.981598:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789127309.981611:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.140@tcp lock: ffff8df798df0800/0xeeacf7c024300465 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c02430046c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127309.981617:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789127309.981628:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.140@tcp lock: ffff8df798df0800/0xeeacf7c024300465 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c02430046c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127309.981634:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: ffff8df798df0800/0xeeacf7c024300465 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c02430046c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127309.981647:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127309.981648:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127309.981650:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127309.981657:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127309.981662:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127309.981673:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7bbd852c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3300:1876035752739712:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789127309.981704:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127309.981728:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789127309.981741:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7bbd870c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3300:1876035752739840:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789127309.981765:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127309.981818:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752739712 00000100:00100000:0.0:1789127309.981823:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752739712 00010000:00010000:0.0:1789127309.981841:0:8454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df79032de00/0xeeacf7c024300488 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xeeacf7c024300481 expref: 19 pid: 5824 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127309.981857:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752739840 00000100:00100000:0.0:1789127309.981860:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752739840 00010000:00010000:0.0:1789127309.981869:0:8454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df798df1e00/0xeeacf7c02430047a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xeeacf7c024300473 expref: 20 pid: 5825 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127309.981886:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789127309.981891:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7889cac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+20:3300:x1876035752739712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789127309.981901:0:8454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789127309.981905:0:8454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df79032de00/0xeeacf7c024300488 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xeeacf7c024300481 expref: 20 pid: 5824 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127309.981975:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7bbd84f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3302:1876035752739968:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789127309.982010:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127309.982043:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752739968 00000100:00100000:3.0:1789127309.982056:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752739968 00010000:00010000:3.0:1789127309.982072:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df798df1c00/0xeeacf7c02430046c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xeeacf7c024300465 expref: 21 pid: 5825 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127309.982087:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789127309.982093:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bbd85680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+21:3300:x1876035752739840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789127309.982102:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127309.982106:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df798df1e00/0xeeacf7c02430047a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xeeacf7c024300473 expref: 21 pid: 5825 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127309.982162:0:11172:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df7ae728600/0xeeacf7c02430045e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7a01 expref: 12 pid: 5825 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127309.982175:0:11172:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a2c4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11172:1876035752739584:192.168.206.40@tcp:104: 00000100:00100000:1.0:1789127309.982211:0:11172:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7bbd933c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789127309.982231:0:11172:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae95a940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11172:1876035752739200:0@lo:104: 00000100:00100000:1.0:1789127309.982240:0:11172:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae95ad00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11172:1876035752739328:0@lo:104: 00000100:00100000:1.0:1789127309.982247:0:11172:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae958f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11172:1876035752739456:0@lo:104: 00010000:00010000:0.0:1789127309.982437:0:8454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df79032de00/0xeeacf7c024300488 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xeeacf7c024300481 expref: 21 pid: 5824 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127309.982453:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df79032de00/0xeeacf7c024300488 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xeeacf7c024300481 expref: 21 pid: 5824 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127309.982465:0:8454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789127309.982508:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7889cac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+20:3300:x1876035752739712:12345-0@lo:103:ldlm_bl.0 Request processed in 616us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127309.982515:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789127309.982555:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789127309.982563:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b4317480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:3302:x1876035752739968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789127309.982577:0:8454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789127309.982582:0:8454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df798df1c00/0xeeacf7c02430046c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xeeacf7c024300465 expref: 19 pid: 5825 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127309.982591:0:8454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df798df1c00/0xeeacf7c02430046c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xeeacf7c024300465 expref: 19 pid: 5825 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127309.982600:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df798df1c00/0xeeacf7c02430046c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xeeacf7c024300465 expref: 19 pid: 5825 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127309.982609:0:8454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789127309.982640:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b4317480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+18:3302:x1876035752739968:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127309.982646:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789127309.982925:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7bbd852c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3300:1876035752739712:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789127309.987539:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7bbd84f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3302:1876035752739968:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789127309.988394:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df798df1e00/0xeeacf7c02430047a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xeeacf7c024300473 expref: 17 pid: 5825 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127309.988420:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df798df1e00/0xeeacf7c02430047a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xeeacf7c024300473 expref: 17 pid: 5825 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127309.988447:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127309.988521:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bbd85680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+16:3300:x1876035752739840:12345-0@lo:103:ldlm_bl.0 Request processed in 6426us (6753us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127309.988531:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789127309.988621:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7bbd870c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3300:1876035752739840:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789127309.989460:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127309.989493:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127309.989551:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733830400 00000100:00100000:0.0:1789127309.989557:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733830400 00010000:00010000:0.0:1789127309.989593:0:8454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df7ae728600/0xeeacf7c02430045e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7a01 expref: 13 pid: 5825 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127309.989623:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733830272 00000100:00100000:0.0:1789127309.989626:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733830272 00010000:00010000:0.0:1789127309.989638:0:8454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df7ae729000/0xeeacf7c02430049d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7a39 expref: 14 pid: 5825 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127309.989656:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 28 00000100:00100000:0.0:1789127309.989663:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79a2c5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d829a69b-d740-4e4c-8301-ef09c9d45165+14:2349:x1876035733830400:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789127309.989677:0:8454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789127309.989696:0:8454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df7ae728600/0xeeacf7c02430045e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7a01 expref: 14 pid: 5825 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127309.989707:0:8454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df7ae728600/0xeeacf7c02430045e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7a01 expref: 14 pid: 5825 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127309.989722:0:8454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789127309.989776:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79a2c5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d829a69b-d740-4e4c-8301-ef09c9d45165+14:2349:x1876035733830400:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 112us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127309.989783:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 28 00000100:00100000:0.0:1789127309.989823:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 29 00000100:00100000:0.0:1789127309.989830:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79a2c5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d829a69b-d740-4e4c-8301-ef09c9d45165+13:2349:x1876035733830272:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789127309.989838:0:8454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789127309.989842:0:8454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df7ae729000/0xeeacf7c02430049d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7a39 expref: 13 pid: 5825 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127309.989851:0:8454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df7ae729000/0xeeacf7c02430049d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7a39 expref: 13 pid: 5825 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127309.989863:0:8454:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8df7bbd96600/0xeeacf7c0243004b9 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127309.989871:0:8454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df7bbd96600/0xeeacf7c0243004b9 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127309.989884:0:8454:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df7bbd96600/0xeeacf7c0243004b9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127309.989891:0:8454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df7bbd96600/0xeeacf7c0243004b9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127309.989908:0:8454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8df7bbd96600/0xeeacf7c0243004b9 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127309.989914:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8df7bbd96600/0xeeacf7c0243004b9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127309.989920:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd96600 already unused, calling callback (ffffffffc17a4550) 00010000:00010000:0.0:1789127309.989924:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8df7bbd96600/0xeeacf7c0243004b9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127309.989932:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8df7bbd96600/0xeeacf7c0243004b9 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127309.989941:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8df7bbd96600/0xeeacf7c0243004b9 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127309.989951:0:8454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789127309.989972:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79a2c5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d829a69b-d740-4e4c-8301-ef09c9d45165+13:2349:x1876035733830272:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 142us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127309.989978:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 29 00010000:00010000:2.0:1789127309.993473:0:11172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df7ae729000/0xeeacf7c02430049d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7a39 expref: 12 pid: 5825 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127309.993492:0:11172:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae958780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11172:1876035752739072:192.168.206.40@tcp:104: 00010000:00010000:3.0:1789127309.994271:0:11172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df7ae728600/0xeeacf7c02430045e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7a01 expref: 11 pid: 5825 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127309.994285:0:11172:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a2c4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11172:1876035752739584:192.168.206.40@tcp:104: 00010000:00010000:3.0:1789127309.994320:0:11172:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8df7bbd96600/0xeeacf7c0243004b9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127309.994340:0:11172:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8df7bbd96600/0xeeacf7c0243004b9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127309.994346:0:11172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8df7bbd96600/0xeeacf7c0243004b9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127309.994351:0:11172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df7bbd96600/0xeeacf7c0243004b9 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127310.772364:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127311.078455:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127311.078610:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733830528 00000100:00100000:0.0:1789127311.078619:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733830528 00000100:00100000:0.0:1789127311.078675:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 233 00000100:00100000:0.0:1789127311.078685:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7880ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d829a69b-d740-4e4c-8301-ef09c9d45165+11:5590:x1876035733830528:12345-192.168.206.40@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789127311.078701:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127311.078720:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df7ae728c00/0xeeacf7c0243004c0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7a63 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127311.078761:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df7ae728c00/0xeeacf7c0243004c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7a63 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127311.078772:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df7ae728c00/0xeeacf7c0243004c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7a63 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127311.078782:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7ae728c00, rc 0) 00000100:00100000:0.0:1789127311.078865:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7880ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d829a69b-d740-4e4c-8301-ef09c9d45165+12:5590:x1876035733830528:12345-192.168.206.40@tcp:101:ll_cfg_requeue.0 Request processed in 180us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127311.078872:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 233 00000100:00100000:0.0:1789127311.096982:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127311.097073:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733830656 00000100:00100000:3.0:1789127311.097083:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733830656 00000100:00100000:3.0:1789127311.097140:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 234 00000100:00100000:3.0:1789127311.097150:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7880ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d829a69b-d740-4e4c-8301-ef09c9d45165+12:5590:x1876035733830656:12345-192.168.206.40@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789127311.097400:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7880ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d829a69b-d740-4e4c-8301-ef09c9d45165+12:5590:x1876035733830656:12345-192.168.206.40@tcp:501:ll_cfg_requeue.0 Request processed in 251us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127311.097409:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 234 00000100:00100000:3.0:1789127311.112330:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127311.112434:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733830784 00000100:00100000:1.0:1789127311.112443:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733830784 00000100:00100000:1.0:1789127311.112498:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 235 00000100:00100000:1.0:1789127311.112508:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7880ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d829a69b-d740-4e4c-8301-ef09c9d45165+12:5590:x1876035733830784:12345-192.168.206.40@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789127311.112733:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7880ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d829a69b-d740-4e4c-8301-ef09c9d45165+12:5590:x1876035733830784:12345-192.168.206.40@tcp:503:ll_cfg_requeue.0 Request processed in 225us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127311.112741:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 235 00000100:00100000:3.0:1789127311.132380:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127311.132450:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733830912 00000100:00100000:0.0:1789127311.132460:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733830912 00000100:00100000:0.0:1789127311.132517:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 236 00000100:00100000:0.0:1789127311.132529:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7880ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d829a69b-d740-4e4c-8301-ef09c9d45165+12:5590:x1876035733830912:12345-192.168.206.40@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789127311.132545:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127311.132564:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df7ae729200/0xeeacf7c0243004c7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7a6a expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127311.132593:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df7ae729200/0xeeacf7c0243004c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7a6a expref: 13 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127311.132604:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df7ae729200/0xeeacf7c0243004c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7a6a expref: 13 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127311.132612:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7ae729200, rc 0) 00000100:00100000:0.0:1789127311.132677:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7880ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d829a69b-d740-4e4c-8301-ef09c9d45165+13:5590:x1876035733830912:12345-192.168.206.40@tcp:101:ll_cfg_requeue.0 Request processed in 150us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127311.132697:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 236 00000100:00100000:0.0:1789127311.138945:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127311.139165:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733831040 00000100:00100000:3.0:1789127311.139174:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733831040 00000100:00100000:3.0:1789127311.139260:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 237 00000100:00100000:3.0:1789127311.139270:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7880aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d829a69b-d740-4e4c-8301-ef09c9d45165+13:5590:x1876035733831040:12345-192.168.206.40@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789127311.139540:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7880aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d829a69b-d740-4e4c-8301-ef09c9d45165+13:5590:x1876035733831040:12345-192.168.206.40@tcp:501:ll_cfg_requeue.0 Request processed in 271us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127311.139548:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 237 00000100:00100000:1.0:1789127311.145730:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127311.145878:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733831168 00000100:00100000:0.0:1789127311.145887:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733831168 00000100:00100000:0.0:1789127311.145993:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 238 00000100:00100000:0.0:1789127311.146005:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7880ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d829a69b-d740-4e4c-8301-ef09c9d45165+13:5590:x1876035733831168:12345-192.168.206.40@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789127311.146237:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7880ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d829a69b-d740-4e4c-8301-ef09c9d45165+13:5590:x1876035733831168:12345-192.168.206.40@tcp:503:ll_cfg_requeue.0 Request processed in 234us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127311.146246:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 238 10000000:01000000:2.0:1789127311.349304:0:5827:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789127311.349310:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df7b45fe800 from 7 10000000:01000000:2.0:1789127311.349314:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789127311.349359:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df79032c200/0xeeacf7c0243004ce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127311.349371:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff8df79032c200/0xeeacf7c0243004ce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127311.349382:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff8df79032c200/0xeeacf7c0243004ce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127311.349406:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df682c73480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752740096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789127311.349471:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127311.349519:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7af618600 going to sleep for 11 seconds 00000100:00100000:3.0:1789127311.349574:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752740096 00000100:00100000:3.0:1789127311.349582:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752740096 00000100:00100000:3.0:1789127311.349631:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1789127311.349640:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7880adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+16:5827:x1876035752740096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789127311.349651:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127311.349664:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df798df1e00/0xeeacf7c0243004d5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xeeacf7c0243004ce expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127311.349686:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df798df1e00/0xeeacf7c0243004d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xeeacf7c0243004ce expref: 17 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127311.349697:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df798df1e00/0xeeacf7c0243004d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c0243004ce expref: 17 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127311.349706:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df798df1e00, rc 0) 00000100:00100000:3.0:1789127311.349753:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7880adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+17:5827:x1876035752740096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127311.349760:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1789127311.350646:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df682c73480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752740096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789127311.350665:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff8df79032c200/0xeeacf7c0243004ce lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c0243004d5 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127311.350675:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff8df79032c200/0xeeacf7c0243004ce lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xeeacf7c0243004d5 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127311.350738:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df682c73480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752740224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789127311.350775:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127311.350827:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7af618600 going to sleep for 11 seconds 00000100:00100000:0.0:1789127311.350940:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752740224 00000100:00100000:0.0:1789127311.350946:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752740224 00000100:00100000:0.0:1789127311.351016:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1789127311.351024:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7880ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+17:5827:x1876035752740224:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789127311.351264:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7880ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+17:5827:x1876035752740224:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 240us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127311.351271:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1789127311.354842:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df682c73480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752740224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789127311.354903:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df682c73480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752740352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789127311.354984:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127311.359364:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7af618600 going to sleep for 11 seconds 00000100:00100000:3.0:1789127311.362908:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752740352 00000100:00100000:3.0:1789127311.362922:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752740352 00000100:00100000:3.0:1789127311.362971:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1789127311.362981:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7880acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+17:5827:x1876035752740352:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789127311.363501:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7880acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+17:5827:x1876035752740352:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 519us (8514us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127311.363509:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1789127311.363629:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df682c73480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752740352:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789127311.364358:0:11200:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1789127311.364409:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1789127311.364435:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789127311.364445:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df79032c200/0xeeacf7c0243004ce lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c0243004d5 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127311.364455:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff8df79032c200/0xeeacf7c0243004ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c0243004d5 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127311.364465:0:5827:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789127311.364468:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df788896800 from 7 10000000:01000000:3.0:1789127311.364471:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789127311.364499:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df798df0e00/0xeeacf7c0243004dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127311.364507:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff8df798df0e00/0xeeacf7c0243004dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127311.364516:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff8df798df0e00/0xeeacf7c0243004dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127311.366701:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7b4315e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752740480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789127311.366772:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127311.366833:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7aeaaf6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789127311.366859:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752740480 00000100:00100000:3.0:1789127311.366866:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752740480 00000100:00100000:3.0:1789127311.366902:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1789127311.366911:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7880afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+17:5827:x1876035752740480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789127311.366925:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127311.366942:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df798df1000/0xeeacf7c0243004e3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xeeacf7c0243004dc expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127311.366979:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df798df1000/0xeeacf7c0243004e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xeeacf7c0243004dc expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127311.366991:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df798df1000/0xeeacf7c0243004e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c0243004dc expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127311.366999:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df798df1000, rc 0) 00000100:00100000:3.0:1789127311.367700:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7880afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+18:5827:x1876035752740480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 788us (926us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127311.367710:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1789127311.369505:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7b4315e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752740480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789127311.369539:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff8df798df0e00/0xeeacf7c0243004dc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c0243004e3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127311.369552:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff8df798df0e00/0xeeacf7c0243004dc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xeeacf7c0243004e3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127311.369630:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df682c730c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752740608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789127311.369684:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127311.369767:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df783e36c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789127311.370442:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752740608 00000100:00100000:0.0:1789127311.370450:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752740608 00000100:00100000:1.0:1789127311.370536:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1789127311.370547:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7880ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+18:5827:x1876035752740608:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789127311.370811:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7880ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+18:5827:x1876035752740608:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 266us (1126us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127311.370819:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1789127311.370913:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df682c730c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752740608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789127311.370951:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df682c730c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752740736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789127311.370991:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127311.371198:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df783e36c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789127311.371257:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752740736 00000100:00100000:3.0:1789127311.371262:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752740736 00000100:00100000:3.0:1789127311.371285:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1789127311.371291:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7880af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+18:5827:x1876035752740736:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789127311.371434:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7880af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+18:5827:x1876035752740736:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 142us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127311.371441:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1789127311.371513:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df682c730c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752740736:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789127311.372277:0:11202:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1789127311.372475:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1789127311.372490:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789127311.372500:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df798df0e00/0xeeacf7c0243004dc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c0243004e3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127311.372511:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff8df798df0e00/0xeeacf7c0243004dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c0243004e3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127311.372520:0:5827:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789127311.372522:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df788820800 from 7 10000000:01000000:3.0:1789127311.372545:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789127311.372576:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df798df1200/0xeeacf7c0243004ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127311.372584:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff8df798df1200/0xeeacf7c0243004ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127311.372592:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff8df798df1200/0xeeacf7c0243004ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127311.372611:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7b4314f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752740864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789127311.372657:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127311.372685:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7aeaaf600 going to sleep for 11 seconds 00000100:00100000:2.0:1789127311.372894:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752740864 00000100:00100000:2.0:1789127311.372899:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752740864 00000100:00100000:2.0:1789127311.372928:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1789127311.372935:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7880ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+18:5827:x1876035752740864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789127311.372946:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127311.372959:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df79032ca00/0xeeacf7c0243004f1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xeeacf7c0243004ea expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127311.372992:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df79032ca00/0xeeacf7c0243004f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xeeacf7c0243004ea expref: 19 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127311.373002:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df79032ca00/0xeeacf7c0243004f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c0243004ea expref: 19 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127311.373081:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df79032ca00, rc 0) 00000100:00100000:2.0:1789127311.373128:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7880ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:5827:x1876035752740864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 193us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127311.373136:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1789127311.373205:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7b4314f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752740864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789127311.373220:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff8df798df1200/0xeeacf7c0243004ea lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c0243004f1 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127311.373229:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff8df798df1200/0xeeacf7c0243004ea lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xeeacf7c0243004f1 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127311.373275:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7b4314f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752740992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789127311.373302:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127311.373324:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7aeaaf600 going to sleep for 11 seconds 00000100:00100000:2.0:1789127311.373365:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752740992 00000100:00100000:2.0:1789127311.373369:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752740992 00000100:00100000:2.0:1789127311.373386:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1789127311.373391:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7880af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:5827:x1876035752740992:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789127311.373603:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7880af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:5827:x1876035752740992:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 210us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127311.373610:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1789127311.373664:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7b4314f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752740992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789127311.373691:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7b4314f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752741120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789127311.373727:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127311.373748:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7aeaaf600 going to sleep for 11 seconds 00000100:00100000:2.0:1789127311.373783:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752741120 00000100:00100000:2.0:1789127311.373813:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752741120 00000100:00100000:2.0:1789127311.373831:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1789127311.373837:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7880ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:5827:x1876035752741120:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789127311.373965:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7880ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:5827:x1876035752741120:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 127us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127311.373972:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1789127311.374125:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7b4314f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752741120:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789127311.376767:0:11203:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1789127311.376952:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1789127311.376971:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789127311.376988:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df798df1200/0xeeacf7c0243004ea lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c0243004f1 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127311.376998:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff8df798df1200/0xeeacf7c0243004ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c0243004f1 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127311.795563:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127312.821166:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127312.883019:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7af7ccb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752741632:0@lo:400:kworker.0 00000100:00100000:1.0:1789127312.883099:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127312.883159:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789127312.883166:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a2c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3302:1876035752741248:0@lo:400:kworker.0 00000100:00100000:1.0:1789127312.883199:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127312.883224:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7af7cd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1876035752741760:0@lo:400:kworker.0 00000100:00100000:1.0:1789127312.883248:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127312.883277:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a2c52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876035752741376:0@lo:400:kworker.0 00000100:00100000:1.0:1789127312.883301:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127312.883319:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7af7cc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1876035752741888:0@lo:400:kworker.0 00000100:00100000:1.0:1789127312.883341:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127312.883360:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789127312.883366:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7af7ccf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1876035752741504:0@lo:400:kworker.0 00000100:00100000:1.0:1789127312.883388:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127312.883419:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752741632 00000100:00100000:1.0:1789127312.883425:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752741632 00000100:00100000:1.0:1789127312.883473:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752741888 00000100:00100000:1.0:1789127312.883476:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752741888 00000100:00100000:1.0:1789127312.883500:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789127312.883508:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79206cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1876035752741632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127312.883556:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79206cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1876035752741632:12345-0@lo:400:kworker.0 Request processed in 49us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127312.883572:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789127312.883588:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789127312.883594:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79206e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1876035752741888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127312.883627:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79206e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1876035752741888:12345-0@lo:400:kworker.0 Request processed in 34us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127312.883633:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789127312.883651:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752741248 00000100:00100000:1.0:1789127312.883654:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752741248 00000100:00100000:1.0:1789127312.883677:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1789127312.883683:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df786b43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:3302:x1876035752741248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127312.883711:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df786b43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:3302:x1876035752741248:12345-0@lo:400:kworker.0 Request processed in 29us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127312.883717:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1789127312.883742:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752741760 00000100:00100000:1.0:1789127312.883746:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752741760 00000100:00100000:1.0:1789127312.883769:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752741376 00000100:00100000:1.0:1789127312.883772:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752741376 00000100:00100000:1.0:1789127312.883782:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752741504 00000100:00100000:1.0:1789127312.883784:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752741504 00000100:00100000:1.0:1789127312.883824:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789127312.883829:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79206de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876035752741760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127312.883860:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79206de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876035752741760:12345-0@lo:400:kworker.0 Request processed in 30us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127312.883866:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789127312.883878:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789127312.883884:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79206d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876035752741376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127312.883921:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79206d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876035752741376:12345-0@lo:400:kworker.0 Request processed in 37us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127312.883928:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789127312.883939:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789127312.883945:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79206fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876035752741504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127312.883970:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79206fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876035752741504:12345-0@lo:400:kworker.0 Request processed in 26us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127312.883975:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:1.0:1789127312.884000:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789127312.884004:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789127312.884007:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789127312.884057:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7af7ccf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1876035752741504:0@lo:400:kworker.0 00000100:00100000:1.0:1789127312.884069:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a2c52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876035752741376:0@lo:400:kworker.0 00010000:00080000:1.0:1789127312.884079:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df7af7cc3c0 x1876035752741888/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127328 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127312.884090:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7af7cc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1876035752741888:0@lo:400:kworker.0 00000100:00100000:1.0:1789127312.884121:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a2c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3302:1876035752741248:0@lo:400:kworker.0 00000100:00100000:1.0:1789127312.884131:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7af7cd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1876035752741760:0@lo:400:kworker.0 00010000:00080000:1.0:1789127312.884141:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df7af7ccb40 x1876035752741632/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127328 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127312.884150:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7af7ccb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752741632:0@lo:400:kworker.0 00000100:00100000:0.0:1789127312.884880:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a2c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1876035752742016:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789127312.884923:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127312.885266:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752742016 00000100:00100000:3.0:1789127312.885273:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752742016 00000100:00100000:3.0:1789127312.885319:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789127312.885327:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bbd870c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876035752742016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789127312.885367:0:10333:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789127312.887502:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bbd870c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876035752742016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2168us (2571us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127312.887514:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:0.0:1789127312.887615:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df79a2c7480 x1876035752742016/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127328 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127312.887640:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a2c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1876035752742016:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789127313.639640:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127313.639678:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127313.639727:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127313.639755:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733831296 00000100:00100000:1.0:1789127313.639763:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733831296 00000100:00100000:1.0:1789127313.639823:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 249 00000100:00100000:1.0:1789127313.639832:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7880af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d829a69b-d740-4e4c-8301-ef09c9d45165+13:2346:x1876035733831296:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:1.0:1789127313.639895:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7880af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d829a69b-d740-4e4c-8301-ef09c9d45165+13:2346:x1876035733831296:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 63us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127313.639902:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 249 00000100:00100000:1.0:1789127313.639934:0:10285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733831424 00000100:00100000:1.0:1789127313.639938:0:10285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733831424 00000100:00100000:1.0:1789127313.639967:0:10285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733831552 00000100:00100000:1.0:1789127313.639970:0:10285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733831552 00000100:00100000:1.0:1789127313.639989:0:10285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 94 00000100:00100000:1.0:1789127313.639996:0:10285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79a2c52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+6:2346:x1876035733831424:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:1.0:1789127313.640037:0:10285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79a2c52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+6:2346:x1876035733831424:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 32us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127313.640044:0:10285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 94 00000100:00100000:1.0:1789127313.640056:0:10285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 95 00000100:00100000:1.0:1789127313.640063:0:10285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79a2c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81b0e267-d7e0-4043-b34e-eec2dc4c5a6b+5:2346:x1876035733831552:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:1.0:1789127313.640091:0:10285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79a2c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81b0e267-d7e0-4043-b34e-eec2dc4c5a6b+5:2346:x1876035733831552:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 28us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127313.640096:0:10285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 95 00000100:00080000:0.0:1789127313.640250:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789127313.846595:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127313.910704:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7af7ccb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752742144:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789127313.910871:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127313.911071:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752742144 00000100:00100000:1.0:1789127313.911078:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752742144 00000100:00100000:1.0:1789127313.911129:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789127313.911139:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df682c730c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876035752742144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789127313.911182:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789127313.911232:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df682c730c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876035752742144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127313.911240:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:1.0:1789127313.911285:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df7af7ccb40 x1876035752742144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127329 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127313.911403:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7af7ccb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752742144:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1789127314.432157:0:11371:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789127314.870610:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127315.903483:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127316.916099:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127317.944224:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127318.002968:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7bbd84f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3303:1876035752742272:0@lo:400:kworker.0 00000100:00100000:0.0:1789127318.003051:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127318.003090:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df78efcd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1876035752742784:0@lo:400:kworker.0 00000100:00100000:0.0:1789127318.003112:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127318.003136:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789127318.003141:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df78efce940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1876035752742656:0@lo:400:kworker.0 00000100:00100000:0.0:1789127318.003163:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127318.003188:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a3a2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876035752742400:0@lo:400:kworker.0 00000100:00100000:0.0:1789127318.003209:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127318.003222:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df78efcc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1876035752742912:0@lo:400:kworker.0 00000100:00100000:0.0:1789127318.003238:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127318.003252:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789127318.003257:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a3a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1876035752742528:0@lo:400:kworker.0 00000100:00100000:0.0:1789127318.003274:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127318.003300:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752742272 00000100:00100000:0.0:1789127318.003305:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752742272 00000100:00100000:0.0:1789127318.003342:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1789127318.003349:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df786b40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:3303:x1876035752742272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127318.003389:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df786b40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:3303:x1876035752742272:12345-0@lo:400:kworker.0 Request processed in 40us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127318.003395:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1789127318.003421:0:10285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752742784 00000100:00100000:0.0:1789127318.003424:0:10285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752742784 00000100:00100000:0.0:1789127318.003450:0:10285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752742400 00000100:00100000:0.0:1789127318.003458:0:10285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752742400 00000100:00100000:0.0:1789127318.003473:0:10285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752742528 00000100:00100000:0.0:1789127318.003475:0:10285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752742528 00000100:00100000:0.0:1789127318.003489:0:10285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789127318.003496:0:10285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df78efce580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876035752742784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127318.003537:0:10285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df78efce580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876035752742784:12345-0@lo:400:kworker.0 Request processed in 42us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127318.003543:0:10285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789127318.003554:0:10285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789127318.003559:0:10285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df78efccb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876035752742400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127318.003595:0:10285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df78efccb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876035752742400:12345-0@lo:400:kworker.0 Request processed in 35us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127318.003600:0:10285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789127318.003610:0:10285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789127318.003616:0:10285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df78efcf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876035752742528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127318.003643:0:10285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df78efcf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876035752742528:12345-0@lo:400:kworker.0 Request processed in 28us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127318.003648:0:10285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789127318.003649:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a3a2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876035752742400:0@lo:400:kworker.0 00000100:00100000:0.0:1789127318.003665:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752742656 00000100:00100000:0.0:1789127318.003668:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752742656 00000100:00100000:1.0:1789127318.003670:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a3a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1876035752742528:0@lo:400:kworker.0 00000100:00100000:0.0:1789127318.003688:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752742912 00000100:00100000:0.0:1789127318.003691:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752742912 00000100:00100000:1.0:1789127318.003693:0:8063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789127318.003699:0:8063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df78efcf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1876035752742656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127318.003707:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789127318.003712:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df78efced00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1876035752742912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127318.003732:0:8063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df78efcf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1876035752742656:12345-0@lo:400:kworker.0 Request processed in 33us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127318.003738:0:8063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789127318.003739:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df78efced00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1876035752742912:12345-0@lo:400:kworker.0 Request processed in 27us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127318.003745:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:1.0:1789127318.003766:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df78efcc780 x1876035752742912/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127334 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789127318.003775:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789127318.003776:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df78efcc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1876035752742912:0@lo:400:kworker.0 00000100:00080000:0.0:1789127318.003778:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789127318.003780:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789127318.003828:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df78efce940 x1876035752742656/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127334 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127318.003837:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df78efce940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1876035752742656:0@lo:400:kworker.0 00000100:00100000:1.0:1789127318.003846:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7bbd84f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3303:1876035752742272:0@lo:400:kworker.0 00000100:00100000:1.0:1789127318.003854:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df78efcd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1876035752742784:0@lo:400:kworker.0 00000100:00100000:1.0:1789127318.004357:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789127318.004366:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7b4314f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1876035752743040:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789127318.004395:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127318.004422:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752743040 00000100:00100000:1.0:1789127318.004426:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752743040 00000100:00100000:1.0:1789127318.004451:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789127318.004457:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7af7cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876035752743040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789127318.004482:0:10333:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789127318.004512:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7af7cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876035752743040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (116us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127318.004518:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:1.0:1789127318.004542:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df7b4314f00 x1876035752743040/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127334 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127318.004555:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7b4314f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1876035752743040:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789127318.761853:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127318.761889:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127318.761915:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127318.761942:0:10285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733831936 00000100:00100000:1.0:1789127318.761950:0:10285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733831936 00000100:00100000:1.0:1789127318.762012:0:10285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733831808 00000100:00100000:1.0:1789127318.762016:0:10285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733831808 00000100:00100000:1.0:1789127318.762038:0:10285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 99 00000100:00100000:1.0:1789127318.762047:0:10285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7af7cd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81b0e267-d7e0-4043-b34e-eec2dc4c5a6b+5:2346:x1876035733831936:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:1.0:1789127318.762132:0:10285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7af7cd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81b0e267-d7e0-4043-b34e-eec2dc4c5a6b+5:2346:x1876035733831936:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 85us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127318.762140:0:10285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 99 00000100:00100000:1.0:1789127318.762171:0:10285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 100 00000100:00100000:1.0:1789127318.762178:0:10285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7af7ccf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+6:2346:x1876035733831808:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:1.0:1789127318.762206:0:10285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7af7ccf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+6:2346:x1876035733831808:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 28us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127318.762212:0:10285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 100 00000100:00080000:1.0:1789127318.762232:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789127318.762461:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733831680 00000100:00100000:3.0:1789127318.762466:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733831680 00000100:00100000:3.0:1789127318.762504:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 251 00000100:00100000:3.0:1789127318.762513:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df786b43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d829a69b-d740-4e4c-8301-ef09c9d45165+13:2346:x1876035733831680:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:3.0:1789127318.762544:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df786b43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d829a69b-d740-4e4c-8301-ef09c9d45165+13:2346:x1876035733831680:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 32us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127318.762550:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 251 00010000:00010000:2.0:1789127318.964634:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127319.027431:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789127319.027451:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df682c70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1876035752743168:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789127319.027518:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127319.027583:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752743168 00000100:00100000:2.0:1789127319.027590:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752743168 00000100:00100000:2.0:1789127319.027634:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789127319.027644:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df682c71e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876035752743168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789127319.027674:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789127319.027728:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df682c71e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876035752743168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127319.027736:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:2.0:1789127319.027777:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df682c70000 x1876035752743168/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127335 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127319.027809:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df682c70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1876035752743168:0@lo:13:osp-pre-0-0.0 00000020:00000080:0.0:1789127319.546928:0:11615:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffb4b9b550 20000000:00000080:0.0:1789127319.546943:0:11615:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8df682bf1400 uarg=0000000000000000 20000000:01000000:0.0:1789127319.546975:0:11615:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='lod.lustre-MDT0000-mdtlov.enable_compr_rotational=1' 20000000:01000000:0.0:1789127319.546981:0:11615:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.lustre-MDT0000-mdtlov.enable_compr_rotational=1' 20000000:01000000:0.0:1789127319.546986:0:11615:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/lod.lustre-MDT0000-mdtlov.enable_compr_rotational=1 del=0 00000040:00080000:3.0:1789127319.548605:0:11616:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:0.0:1789127319.548779:0:11615:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.lod.lustre-MDT0000-mdtlov.enable_compr_rotational=1 in log params 00000040:00080000:0.0:1789127319.556032:0:11615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:0.0:1789127319.556092:0:11615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 144 off9680 00000040:00080000:0.0:1789127319.556152:0:11615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9904 10000000:01000000:0.0:1789127319.556170:0:11615:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789127319.556190:0:11615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8df7ae729400/0xeeacf7c0243004f8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127319.556212:0:11615:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df7ae728c00/0xeeacf7c0243004c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7a63 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127319.556220:0:11615:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df7ae729200/0xeeacf7c0243004c7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7a6a expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127319.556228:0:11615:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df798df1e00/0xeeacf7c0243004d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c0243004ce expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127319.556248:0:11615:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df798df1000/0xeeacf7c0243004e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c0243004dc expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127319.556264:0:11615:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df79032ca00/0xeeacf7c0243004f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c0243004ea expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127319.556285:0:11615:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8df7ae729400/0xeeacf7c0243004f8 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127319.556323:0:11615:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df79032ca00/0xeeacf7c0243004f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xeeacf7c0243004ea expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127319.556338:0:11615:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df79032ca00/0xeeacf7c0243004f1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xeeacf7c0243004ea expref: 18 pid: 5825 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127319.556352:0:11615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df78efccf00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11615:1876035752743296:0@lo:104: 00000100:00100000:0.0:1789127319.556420:0:11615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789127319.556493:0:11615:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df798df1000/0xeeacf7c0243004e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xeeacf7c0243004dc expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127319.556503:0:11615:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df798df1000/0xeeacf7c0243004e3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xeeacf7c0243004dc expref: 18 pid: 5825 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127319.556512:0:11615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df78efce1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11615:1876035752743424:0@lo:104: 00000100:00100000:0.0:1789127319.556534:0:11615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789127319.556555:0:11615:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df798df1e00/0xeeacf7c0243004d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xeeacf7c0243004ce expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127319.556562:0:11615:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df798df1e00/0xeeacf7c0243004d5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xeeacf7c0243004ce expref: 18 pid: 5825 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127319.556571:0:11615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df78efcde00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11615:1876035752743552:0@lo:104: 00000100:00100000:0.0:1789127319.556593:0:11615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127319.556631:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789127319.556642:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752743296 00000100:00100000:0.0:1789127319.556655:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752743296 00000100:00100000:0.0:1789127319.556688:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752743424 00000100:00100000:0.0:1789127319.556691:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752743424 00000100:00100000:0.0:1789127319.556700:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752743552 00000100:00100000:0.0:1789127319.556703:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752743552 00000100:00100000:0.0:1789127319.556716:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789127319.556723:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df78efcf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+5:11615:x1876035752743296:12345-0@lo:104: 00010000:00010000:0.0:1789127319.556733:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.140@tcp lock: ffff8df798df1200/0xeeacf7c0243004ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xeeacf7c0243004f1 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127319.556777:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789127319.556783:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df78efcf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+5:11615:x1876035752743296:12345-0@lo:104: Request processed in 61us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127319.556829:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789127319.556846:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789127319.556853:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df78efcd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+4:11615:x1876035752743424:12345-0@lo:104: 00010000:00010000:0.0:1789127319.556860:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.140@tcp lock: ffff8df798df0e00/0xeeacf7c0243004dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xeeacf7c0243004e3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127319.556892:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789127319.556897:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df78efcd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+4:11615:x1876035752743424:12345-0@lo:104: Request processed in 46us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127319.556903:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789127319.556915:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789127319.556921:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6824d5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+3:11615:x1876035752743552:12345-0@lo:104: 00010000:00010000:0.0:1789127319.556927:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.140@tcp lock: ffff8df79032c200/0xeeacf7c0243004ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xeeacf7c0243004d5 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127319.556955:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789127319.556966:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6824d5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+3:11615:x1876035752743552:12345-0@lo:104: Request processed in 45us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127319.556971:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:0.0:1789127319.557019:0:8511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789127319.557025:0:8511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.140@tcp lock: ffff8df798df1200/0xeeacf7c0243004ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xeeacf7c0243004f1 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127319.557032:0:8511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df798df1200 already unused, calling callback (ffffffffc1da1c20) 10000000:00010000:0.0:1789127319.557036:0:8511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.140@tcp lock: ffff8df798df1200/0xeeacf7c0243004ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xeeacf7c0243004f1 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127319.557043:0:8511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: ffff8df798df1200/0xeeacf7c0243004ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xeeacf7c0243004f1 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789127319.557049:0:8511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: ffff8df798df1200/0xeeacf7c0243004ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xeeacf7c0243004f1 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127319.557055:0:8511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789127319.557081:0:8511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.140@tcp lock: ffff8df798df1200/0xeeacf7c0243004ea lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c0243004f1 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127319.557087:0:8511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789127319.557104:0:8511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.140@tcp lock: ffff8df798df1200/0xeeacf7c0243004ea lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c0243004f1 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127319.557111:0:8511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: ffff8df798df1200/0xeeacf7c0243004ea lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c0243004f1 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127319.557123:0:8511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789127319.557126:0:8511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.140@tcp lock: ffff8df798df0e00/0xeeacf7c0243004dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xeeacf7c0243004e3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127319.557142:0:8511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df798df0e00 already unused, calling callback (ffffffffc1da1c20) 10000000:00010000:0.0:1789127319.557144:0:8511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.140@tcp lock: ffff8df798df0e00/0xeeacf7c0243004dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xeeacf7c0243004e3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127319.557150:0:8511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: ffff8df798df0e00/0xeeacf7c0243004dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xeeacf7c0243004e3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789127319.557156:0:8511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: ffff8df798df0e00/0xeeacf7c0243004dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xeeacf7c0243004e3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127319.557160:0:8511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789127319.557171:0:8511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.140@tcp lock: ffff8df798df0e00/0xeeacf7c0243004dc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c0243004e3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127319.557176:0:8511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789127319.557188:0:8511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.140@tcp lock: ffff8df798df0e00/0xeeacf7c0243004dc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c0243004e3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127319.557199:0:8511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: ffff8df798df0e00/0xeeacf7c0243004dc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c0243004e3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127319.557212:0:8511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789127319.557215:0:8511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.140@tcp lock: ffff8df79032c200/0xeeacf7c0243004ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xeeacf7c0243004d5 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127319.557220:0:8511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df79032c200 already unused, calling callback (ffffffffc1da1c20) 10000000:00010000:0.0:1789127319.557223:0:8511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.140@tcp lock: ffff8df79032c200/0xeeacf7c0243004ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xeeacf7c0243004d5 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127319.557238:0:8511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: ffff8df79032c200/0xeeacf7c0243004ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xeeacf7c0243004d5 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789127319.557243:0:8511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: ffff8df79032c200/0xeeacf7c0243004ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xeeacf7c0243004d5 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127319.557248:0:8511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789127319.557262:0:8511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.140@tcp lock: ffff8df79032c200/0xeeacf7c0243004ce lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c0243004d5 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127319.557267:0:8511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789127319.557272:0:8511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.140@tcp lock: ffff8df79032c200/0xeeacf7c0243004ce lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c0243004d5 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127319.557278:0:8511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: ffff8df79032c200/0xeeacf7c0243004ce lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c0243004d5 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127319.557292:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127319.557294:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127319.557295:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127319.557308:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df78efcda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3301:1876035752743936:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789127319.557335:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127319.557361:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789127319.557366:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df78efcd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3301:1876035752743808:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789127319.557386:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789127319.557420:0:11615:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df7ae729200/0xeeacf7c0243004c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7a6a expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127319.557431:0:11615:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df7ae729200/0xeeacf7c0243004c7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7a6a expref: 12 pid: 5824 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127319.557448:0:11615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df78efcd680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11615:1876035752744064:192.168.206.40@tcp:104: 00000100:00100000:3.0:1789127319.557466:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752743936 00000100:00100000:3.0:1789127319.557474:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752743936 00010000:00010000:0.0:1789127319.557504:0:11615:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df7ae728c00/0xeeacf7c0243004c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7a63 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127319.557512:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df798df1e00/0xeeacf7c0243004d5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xeeacf7c0243004ce expref: 19 pid: 5825 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127319.557517:0:11615:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df7ae728c00/0xeeacf7c0243004c0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7a63 expref: 12 pid: 5824 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127319.557532:0:11615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df78efce940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11615:1876035752744192:192.168.206.40@tcp:104: 00000100:00100000:3.0:1789127319.557540:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752743808 00000100:00100000:3.0:1789127319.557545:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752743808 00010000:00010000:3.0:1789127319.557558:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df798df1000/0xeeacf7c0243004e3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xeeacf7c0243004dc expref: 20 pid: 5825 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127319.557591:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789127319.557599:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df78efcc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+20:3301:x1876035752743936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789127319.557610:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127319.557616:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df798df1e00/0xeeacf7c0243004d5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xeeacf7c0243004ce expref: 20 pid: 5825 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127319.557626:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df798df1e00/0xeeacf7c0243004d5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xeeacf7c0243004ce expref: 20 pid: 5825 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127319.557641:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127319.557675:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df78efcc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+20:3301:x1876035752743936:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127319.557682:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789127319.557696:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789127319.557703:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df78efcc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:3301:x1876035752743808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789127319.557711:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127319.557716:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df798df1000/0xeeacf7c0243004e3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xeeacf7c0243004dc expref: 19 pid: 5825 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127319.557724:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df798df1000/0xeeacf7c0243004e3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xeeacf7c0243004dc expref: 19 pid: 5825 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127319.557733:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789127319.557738:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789127319.557753:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df78efcf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3302:1876035752743680:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789127319.557759:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df78efcc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:3301:x1876035752743808:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127319.557766:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789127319.557806:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127319.557857:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df78efcd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3301:1876035752743808:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789127319.557874:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df78efcda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3301:1876035752743936:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789127319.558640:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127319.558654:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127319.559342:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752743680 00000100:00100000:1.0:1789127319.559444:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752743680 00010000:00010000:1.0:1789127319.559479:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df79032ca00/0xeeacf7c0243004f1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xeeacf7c0243004ea expref: 19 pid: 5825 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127319.559520:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789127319.559529:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7889ca850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:3302:x1876035752743680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789127319.559541:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789127319.559547:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df79032ca00/0xeeacf7c0243004f1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xeeacf7c0243004ea expref: 19 pid: 5825 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127319.559559:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df79032ca00/0xeeacf7c0243004f1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xeeacf7c0243004ea expref: 19 pid: 5825 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127319.559576:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789127319.559629:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7889ca850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:3302:x1876035752743680:12345-0@lo:103:ldlm_bl.0 Request processed in 101us (1822us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127319.559636:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789127319.560169:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df78efcf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3302:1876035752743680:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789127319.560822:0:11615:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7ae298180 going to sleep for 11 seconds 00010000:00010000:0.0:1789127319.560842:0:11615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df79032ca00/0xeeacf7c0243004f1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xeeacf7c0243004ea expref: 18 pid: 5825 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127319.560856:0:11615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df78efccf00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11615:1876035752743296:0@lo:104: 00010000:00010000:0.0:1789127319.560868:0:11615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df798df1000/0xeeacf7c0243004e3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xeeacf7c0243004dc expref: 17 pid: 5825 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127319.560876:0:11615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df78efce1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11615:1876035752743424:0@lo:104: 00010000:00010000:0.0:1789127319.560884:0:11615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df798df1e00/0xeeacf7c0243004d5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xeeacf7c0243004ce expref: 16 pid: 5825 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127319.560892:0:11615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df78efcde00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11615:1876035752743552:0@lo:104: 00000100:00100000:1.0:1789127319.566604:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127319.566696:0:11615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df78efcd680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11615:1876035752744064:192.168.206.40@tcp:104: 00000100:00100000:0.0:1789127319.566708:0:11615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df78efce940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11615:1876035752744192:192.168.206.40@tcp:104: 00010000:00010000:0.0:1789127319.566743:0:11615:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8df7ae729400/0xeeacf7c0243004f8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127319.566876:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127319.567591:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733832064 00000100:00100000:3.0:1789127319.567601:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733832064 00010000:00010000:3.0:1789127319.567639:0:8454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df7ae729200/0xeeacf7c0243004c7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7a6a expref: 13 pid: 5824 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127319.567709:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733832192 00000100:00100000:3.0:1789127319.567713:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733832192 00010000:00010000:3.0:1789127319.567726:0:8454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df7ae728c00/0xeeacf7c0243004c0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7a63 expref: 14 pid: 5824 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127319.567759:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 33 00000100:00100000:2.0:1789127319.567770:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7af7ccb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d829a69b-d740-4e4c-8301-ef09c9d45165+14:2348:x1876035733832064:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789127319.567784:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789127319.567821:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df7ae729200/0xeeacf7c0243004c7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7a6a expref: 14 pid: 5824 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127319.567832:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df7ae729200/0xeeacf7c0243004c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7a6a expref: 14 pid: 5824 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127319.567851:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df7ae729200/0xeeacf7c0243004c7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7a6a expref: 14 pid: 5824 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127319.567865:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789127319.567922:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7af7ccb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d829a69b-d740-4e4c-8301-ef09c9d45165+13:2348:x1876035733832064:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 154us (1327us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127319.567929:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 33 00000100:00100000:2.0:1789127319.567959:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 34 00000100:00100000:2.0:1789127319.567975:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bbd85680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d829a69b-d740-4e4c-8301-ef09c9d45165+12:2348:x1876035733832192:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789127319.567983:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789127319.567988:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df7ae728c00/0xeeacf7c0243004c0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7a63 expref: 12 pid: 5824 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127319.568009:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df7ae728c00/0xeeacf7c0243004c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7a63 expref: 12 pid: 5824 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127319.568019:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df7ae728c00/0xeeacf7c0243004c0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7a63 expref: 12 pid: 5824 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127319.568043:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8df7ae729400/0xeeacf7c0243004f8 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127319.568051:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df7ae729400/0xeeacf7c0243004f8 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127319.568064:0:5816:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df7ae729400/0xeeacf7c0243004f8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127319.568071:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df7ae729400/0xeeacf7c0243004f8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127319.568078:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8df7ae729400/0xeeacf7c0243004f8 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127319.568084:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8df7ae729400/0xeeacf7c0243004f8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127319.568090:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7ae729400 already unused, calling callback (ffffffffc17a4550) 00010000:00010000:2.0:1789127319.568093:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8df7ae729400/0xeeacf7c0243004f8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127319.568100:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8df7ae729400/0xeeacf7c0243004f8 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127319.568113:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8df7ae729400/0xeeacf7c0243004f8 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127319.568122:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789127319.568142:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bbd85680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d829a69b-d740-4e4c-8301-ef09c9d45165+11:2348:x1876035733832192:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 177us (1267us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127319.568159:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 34 00010000:00010000:0.0:1789127319.568393:0:11615:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8df7ae729400/0xeeacf7c0243004f8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127319.568402:0:11615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8df7ae729400/0xeeacf7c0243004f8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127319.568408:0:11615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df7ae729400/0xeeacf7c0243004f8 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127319.987911:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789127320.754914:0:5827:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789127320.754922:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df7b45fe800 from 7 10000000:01000000:2.0:1789127320.754927:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789127320.755000:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df79032ca00/0xeeacf7c0243004ff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127320.755011:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff8df79032ca00/0xeeacf7c0243004ff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127320.755022:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff8df79032ca00/0xeeacf7c0243004ff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127320.755048:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df682c712c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752744320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789127320.755131:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127320.755212:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7ae191780 going to sleep for 11 seconds 00000100:00100000:0.0:1789127320.755400:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752744320 00000100:00100000:0.0:1789127320.755409:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752744320 00000100:00100000:0.0:1789127320.755565:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1789127320.755576:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7902d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+16:5827:x1876035752744320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789127320.755591:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127320.755606:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df7ae728e00/0xeeacf7c024300506 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xeeacf7c0243004ff expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127320.755628:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df7ae728e00/0xeeacf7c024300506 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xeeacf7c0243004ff expref: 17 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127320.755640:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df7ae728e00/0xeeacf7c024300506 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c0243004ff expref: 17 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127320.755649:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7ae728e00, rc 0) 00000100:00100000:0.0:1789127320.755703:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7902d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+17:5827:x1876035752744320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127320.755710:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1789127320.756115:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df682c712c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752744320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789127320.756133:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff8df79032ca00/0xeeacf7c0243004ff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c024300506 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127320.756142:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff8df79032ca00/0xeeacf7c0243004ff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xeeacf7c024300506 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127320.756202:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df682c712c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752744448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789127320.756232:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127320.756263:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7ae191780 going to sleep for 11 seconds 00000100:00100000:1.0:1789127320.756342:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752744448 00000100:00100000:1.0:1789127320.756348:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752744448 00000100:00100000:1.0:1789127320.756385:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1789127320.756393:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7902da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+17:5827:x1876035752744448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789127320.756643:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7902da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+17:5827:x1876035752744448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 249us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127320.756651:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1789127320.757380:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df682c712c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752744448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789127320.757434:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df682c712c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752744576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789127320.757479:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127320.757516:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7ae191780 going to sleep for 11 seconds 00000100:00100000:0.0:1789127320.757584:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752744576 00000100:00100000:0.0:1789127320.757590:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752744576 00000100:00100000:0.0:1789127320.757630:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1789127320.757638:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df790dc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+17:5827:x1876035752744576:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789127320.757829:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df790dc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+17:5827:x1876035752744576:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 191us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127320.757836:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1789127320.758069:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df682c712c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752744576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789127320.759321:0:11676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df78efcfc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:11676:1876035752744704:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789127320.759384:0:11676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127320.759425:0:11676:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7ae298900 going to sleep for 11 seconds 00000100:00100000:1.0:1789127320.759456:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752744704 00000100:00100000:1.0:1789127320.759463:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752744704 00000100:00100000:1.0:1789127320.759508:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1789127320.759518:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df790dc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+17:11676:x1876035752744704:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789127320.759715:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df790dc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+17:11676:x1876035752744704:12345-0@lo:502:llog_process_th.0 Request processed in 199us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127320.759723:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1789127320.761459:0:11676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df78efcfc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:11676:1876035752744704:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789127320.761501:0:11676:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789127320.761512:0:11676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127320.761514:0:11676:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:0.0:1789127320.761521:0:11676:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8df7b45fe800 00000020:00000080:0.0:1789127320.761523:0:11676:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789127320.761621:0:11676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df78efcfc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:11676:1876035752744832:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789127320.761679:0:11676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127320.761719:0:11676:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7ae298900 going to sleep for 11 seconds 00000100:00100000:3.0:1789127320.765229:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752744832 00000100:00100000:3.0:1789127320.765241:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752744832 00000100:00100000:3.0:1789127320.765297:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1789127320.765307:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df787bb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+17:11676:x1876035752744832:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789127320.765543:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df787bb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+17:11676:x1876035752744832:12345-0@lo:502:llog_process_th.0 Request processed in 237us (3862us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127320.765550:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1789127320.766851:0:11676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df78efcfc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:11676:1876035752744832:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789127320.766886:0:11676:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789127320.766895:0:11676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127320.766897:0:11676:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000040:00080000:0.0:1789127320.766901:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1789127320.768370:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1789127320.768394:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789127320.768405:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df79032ca00/0xeeacf7c0243004ff lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c024300506 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127320.768416:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff8df79032ca00/0xeeacf7c0243004ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c024300506 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127320.768427:0:5827:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789127320.768429:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df788896800 from 7 10000000:01000000:2.0:1789127320.768432:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789127320.768467:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df79032c200/0xeeacf7c02430050d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127320.768475:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff8df79032c200/0xeeacf7c02430050d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127320.768485:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff8df79032c200/0xeeacf7c02430050d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127320.768508:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df682c712c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752744960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789127320.768570:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127320.768606:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7ae191780 going to sleep for 11 seconds 00000100:00100000:0.0:1789127320.768683:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752744960 00000100:00100000:0.0:1789127320.768689:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752744960 00000100:00100000:0.0:1789127320.768741:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1789127320.768763:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df787bbb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+17:5827:x1876035752744960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789127320.768777:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127320.768815:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df7ae729000/0xeeacf7c024300514 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xeeacf7c02430050d expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127320.768838:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df7ae729000/0xeeacf7c024300514 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xeeacf7c02430050d expref: 18 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127320.768848:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df7ae729000/0xeeacf7c024300514 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c02430050d expref: 18 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127320.768856:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7ae729000, rc 0) 00000100:00100000:0.0:1789127320.768898:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df787bbb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+18:5827:x1876035752744960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127320.768905:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1789127320.769125:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df682c712c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752744960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789127320.769146:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff8df79032c200/0xeeacf7c02430050d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c024300514 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127320.769155:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff8df79032c200/0xeeacf7c02430050d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xeeacf7c024300514 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127320.769201:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df682c712c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752745088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789127320.769229:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127320.769255:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7ae191780 going to sleep for 11 seconds 00000100:00100000:0.0:1789127320.769673:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752745088 00000100:00100000:0.0:1789127320.769679:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752745088 00000100:00100000:0.0:1789127320.769713:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1789127320.769720:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df787bb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+18:5827:x1876035752745088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789127320.770135:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df787bb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+18:5827:x1876035752745088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 414us (903us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127320.770143:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1789127320.773157:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df682c712c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752745088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789127320.773225:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df682c712c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752745216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789127320.773304:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127320.773342:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7ae191780 going to sleep for 11 seconds 00000100:00100000:0.0:1789127320.773660:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752745216 00000100:00100000:0.0:1789127320.773667:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752745216 00000100:00100000:0.0:1789127320.773706:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1789127320.773715:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df787bb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+18:5827:x1876035752745216:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789127320.773911:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df787bb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+18:5827:x1876035752745216:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 195us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127320.773926:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1789127320.774371:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df682c712c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752745216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789127320.779316:0:11678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df682c712c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:11678:1876035752745344:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789127320.779394:0:11678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127320.779439:0:11678:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7ae191c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789127320.779499:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752745344 00000100:00100000:3.0:1789127320.779505:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752745344 00000100:00100000:3.0:1789127320.779550:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1789127320.779563:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df787bb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+18:11678:x1876035752745344:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789127320.779776:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df787bb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+18:11678:x1876035752745344:12345-0@lo:502:llog_process_th.0 Request processed in 213us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127320.779811:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1789127320.782199:0:11678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df682c712c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:11678:1876035752745344:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789127320.782244:0:11678:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789127320.782254:0:11678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127320.782257:0:11678:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:2.0:1789127320.782263:0:11678:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8df788896800 00000020:00000080:2.0:1789127320.782265:0:11678:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789127320.782344:0:11678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df682c712c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:11678:1876035752745472:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789127320.782406:0:11678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127320.782449:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752745472 00000100:00100000:2.0:1789127320.782455:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752745472 00000100:00100000:2.0:1789127320.782489:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1789127320.782496:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df787bb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+18:11678:x1876035752745472:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789127320.782676:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df787bb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+18:11678:x1876035752745472:12345-0@lo:502:llog_process_th.0 Request processed in 180us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127320.782683:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1789127320.782771:0:11678:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7ae191c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789127320.782785:0:11678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df682c712c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:11678:1876035752745472:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789127320.782820:0:11678:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789127320.782825:0:11678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127320.782827:0:11678:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000040:00080000:2.0:1789127320.782830:0:11678:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1789127320.783387:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1789127320.783404:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789127320.783420:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df79032c200/0xeeacf7c02430050d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c024300514 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127320.783431:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff8df79032c200/0xeeacf7c02430050d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c024300514 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127320.783440:0:5827:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789127320.783443:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df788820800 from 7 10000000:01000000:3.0:1789127320.783445:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789127320.783471:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df798df0800/0xeeacf7c02430051b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127320.783479:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff8df798df0800/0xeeacf7c02430051b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127320.783488:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff8df798df0800/0xeeacf7c02430051b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127320.783504:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7b4316d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752745600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789127320.783541:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127320.783577:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7889e90c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789127320.789731:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752745600 00000100:00100000:2.0:1789127320.789744:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752745600 00000100:00100000:2.0:1789127320.789830:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1789127320.789841:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df787bbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+18:5827:x1876035752745600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789127320.789856:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127320.789876:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df79032d200/0xeeacf7c024300522 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xeeacf7c02430051b expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127320.789902:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df79032d200/0xeeacf7c024300522 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xeeacf7c02430051b expref: 19 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127320.789913:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df79032d200/0xeeacf7c024300522 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c02430051b expref: 19 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127320.789921:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df79032d200, rc 0) 00000100:00100000:2.0:1789127320.790035:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df787bbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:5827:x1876035752745600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 197us (6493us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127320.790043:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1789127320.790250:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7b4316d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752745600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789127320.790267:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff8df798df0800/0xeeacf7c02430051b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c024300522 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127320.790277:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff8df798df0800/0xeeacf7c02430051b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xeeacf7c024300522 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127320.790339:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7b4316d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752745728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789127320.790381:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127320.790417:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7889e90c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789127320.790473:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752745728 00000100:00100000:2.0:1789127320.790477:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752745728 00000100:00100000:2.0:1789127320.790507:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1789127320.790514:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df787bba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:5827:x1876035752745728:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789127320.790729:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df787bba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:5827:x1876035752745728:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 215us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127320.790736:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1789127320.790827:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7b4316d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752745728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789127320.790854:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7b4316d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752745856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789127320.790896:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127320.790912:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7889e90c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789127320.793159:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752745856 00000100:00100000:2.0:1789127320.793171:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752745856 00000100:00100000:2.0:1789127320.793220:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1789127320.793229:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df787bb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:5827:x1876035752745856:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789127320.793441:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df787bb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:5827:x1876035752745856:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 212us (2542us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127320.793449:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1789127320.793569:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7b4316d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752745856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789127320.794177:0:11680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7b4316d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:11680:1876035752745984:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789127320.794231:0:11680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127320.794269:0:11680:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7889e9f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789127320.797102:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752745984 00000100:00100000:2.0:1789127320.797115:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752745984 00000100:00100000:2.0:1789127320.797172:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1789127320.797182:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df788035050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:11680:x1876035752745984:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789127320.797428:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df788035050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:11680:x1876035752745984:12345-0@lo:502:llog_process_th.0 Request processed in 246us (3196us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127320.797437:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1789127320.797577:0:11680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7b4316d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:11680:1876035752745984:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789127320.797612:0:11680:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789127320.797622:0:11680:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127320.797625:0:11680:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:3.0:1789127320.797631:0:11680:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8df788820800 00000020:00000080:3.0:1789127320.797634:0:11680:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789127320.797723:0:11680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7b4316d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:11680:1876035752746112:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789127320.797771:0:11680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127320.797831:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752746112 00000100:00100000:3.0:1789127320.797836:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752746112 00000100:00100000:3.0:1789127320.797859:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1789127320.797865:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df788035850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:11680:x1876035752746112:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789127320.798006:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df788035850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:11680:x1876035752746112:12345-0@lo:502:llog_process_th.0 Request processed in 140us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127320.798021:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1789127320.798060:0:11680:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7889e9f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789127320.798072:0:11680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7b4316d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:11680:1876035752746112:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789127320.798088:0:11680:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789127320.798092:0:11680:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127320.798094:0:11680:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000040:00080000:3.0:1789127320.798097:0:11680:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1789127320.799148:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1789127320.799170:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789127320.799181:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df798df0800/0xeeacf7c02430051b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c024300522 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127320.799197:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff8df798df0800/0xeeacf7c02430051b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c024300522 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127320.873215:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127320.873284:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733832320 00000100:00100000:3.0:1789127320.873293:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733832320 00000100:00100000:3.0:1789127320.873348:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 267 00000100:00100000:3.0:1789127320.873357:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df788034050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d829a69b-d740-4e4c-8301-ef09c9d45165+11:5590:x1876035733832320:12345-192.168.206.40@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789127320.873373:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127320.873389:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df798df1c00/0xeeacf7c024300529 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7a71 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127320.873415:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df798df1c00/0xeeacf7c024300529 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7a71 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127320.873426:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df798df1c00/0xeeacf7c024300529 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7a71 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127320.873434:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df798df1c00, rc 0) 00000100:00100000:3.0:1789127320.873494:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df788034050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d829a69b-d740-4e4c-8301-ef09c9d45165+12:5590:x1876035733832320:12345-192.168.206.40@tcp:101:ll_cfg_requeue.0 Request processed in 137us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127320.873503:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 267 00000100:00100000:1.0:1789127320.880674:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127320.880745:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733832448 00000100:00100000:2.0:1789127320.880753:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733832448 00000100:00100000:2.0:1789127320.880845:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 268 00000100:00100000:2.0:1789127320.880855:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df788035450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d829a69b-d740-4e4c-8301-ef09c9d45165+12:5590:x1876035733832448:12345-192.168.206.40@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789127320.881153:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df788035450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d829a69b-d740-4e4c-8301-ef09c9d45165+12:5590:x1876035733832448:12345-192.168.206.40@tcp:501:ll_cfg_requeue.0 Request processed in 297us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127320.881161:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 268 00000100:00100000:2.0:1789127320.886860:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127320.886943:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733832576 00000100:00100000:3.0:1789127320.886953:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733832576 00000100:00100000:3.0:1789127320.887042:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 269 00000100:00100000:3.0:1789127320.887052:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df788036c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d829a69b-d740-4e4c-8301-ef09c9d45165+12:5590:x1876035733832576:12345-192.168.206.40@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789127320.887263:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df788036c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d829a69b-d740-4e4c-8301-ef09c9d45165+12:5590:x1876035733832576:12345-192.168.206.40@tcp:503:ll_cfg_requeue.0 Request processed in 212us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127320.887271:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 269 00000100:00100000:3.0:1789127320.896495:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127320.902015:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733832704 00000100:00100000:1.0:1789127320.902030:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733832704 00000100:00100000:1.0:1789127320.902092:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 270 00000100:00100000:1.0:1789127320.902219:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df788036850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d829a69b-d740-4e4c-8301-ef09c9d45165+12:9504:x1876035733832704:12345-192.168.206.40@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789127320.902463:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df788036850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d829a69b-d740-4e4c-8301-ef09c9d45165+12:9504:x1876035733832704:12345-192.168.206.40@tcp:502:llog_process_th.0 Request processed in 245us (5976us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127320.911034:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 270 00000100:00100000:1.0:1789127320.920454:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127320.920535:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733832832 00000100:00100000:2.0:1789127320.920545:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733832832 00000100:00100000:2.0:1789127320.920600:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 271 00000100:00100000:2.0:1789127320.920610:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df788035c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d829a69b-d740-4e4c-8301-ef09c9d45165+12:9504:x1876035733832832:12345-192.168.206.40@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789127320.920874:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df788035c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d829a69b-d740-4e4c-8301-ef09c9d45165+12:9504:x1876035733832832:12345-192.168.206.40@tcp:502:llog_process_th.0 Request processed in 264us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127320.920883:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 271 00000100:00100000:2.0:1789127320.927106:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127320.927191:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733832960 00000100:00100000:1.0:1789127320.927213:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733832960 00000100:00100000:1.0:1789127320.927265:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 272 00000100:00100000:1.0:1789127320.927275:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df788036450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d829a69b-d740-4e4c-8301-ef09c9d45165+12:5590:x1876035733832960:12345-192.168.206.40@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789127320.927292:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127320.927309:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df7bbd96400/0xeeacf7c024300530 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7a78 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127320.927336:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df7bbd96400/0xeeacf7c024300530 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7a78 expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127320.927347:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df7bbd96400/0xeeacf7c024300530 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7a78 expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127320.927358:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7bbd96400, rc 0) 00000100:00100000:1.0:1789127320.927415:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df788036450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d829a69b-d740-4e4c-8301-ef09c9d45165+13:5590:x1876035733832960:12345-192.168.206.40@tcp:101:ll_cfg_requeue.0 Request processed in 141us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127320.927422:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 272 00000100:00100000:3.0:1789127320.953106:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127320.955389:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733833088 00000100:00100000:1.0:1789127320.955402:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733833088 00000100:00100000:1.0:1789127320.955476:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 273 00000100:00100000:1.0:1789127320.955486:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df788034c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d829a69b-d740-4e4c-8301-ef09c9d45165+13:5590:x1876035733833088:12345-192.168.206.40@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789127320.955768:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df788034c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d829a69b-d740-4e4c-8301-ef09c9d45165+13:5590:x1876035733833088:12345-192.168.206.40@tcp:501:ll_cfg_requeue.0 Request processed in 283us (2671us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127320.955777:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 273 00000100:00100000:3.0:1789127320.964315:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127320.964631:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733833216 00000100:00100000:2.0:1789127320.964641:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733833216 00000100:00100000:2.0:1789127320.964694:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 274 00000100:00100000:2.0:1789127320.964702:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df788037c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d829a69b-d740-4e4c-8301-ef09c9d45165+13:5590:x1876035733833216:12345-192.168.206.40@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789127320.964941:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df788037c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d829a69b-d740-4e4c-8301-ef09c9d45165+13:5590:x1876035733833216:12345-192.168.206.40@tcp:503:ll_cfg_requeue.0 Request processed in 239us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127320.964950:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 274 00000100:00100000:2.0:1789127320.973857:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127320.974026:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733833344 00000100:00100000:3.0:1789127320.974036:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733833344 00000100:00100000:3.0:1789127320.974087:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 275 00000100:00100000:3.0:1789127320.974096:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df788036050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d829a69b-d740-4e4c-8301-ef09c9d45165+13:9507:x1876035733833344:12345-192.168.206.40@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789127320.974351:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df788036050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d829a69b-d740-4e4c-8301-ef09c9d45165+13:9507:x1876035733833344:12345-192.168.206.40@tcp:502:llog_process_th.0 Request processed in 255us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127320.974359:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 275 00000100:00100000:3.0:1789127320.992319:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127320.993052:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733833472 00000100:00100000:1.0:1789127320.993064:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733833472 00000100:00100000:1.0:1789127320.993125:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 276 00000100:00100000:1.0:1789127320.993135:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df788034450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d829a69b-d740-4e4c-8301-ef09c9d45165+13:9507:x1876035733833472:12345-192.168.206.40@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789127320.993385:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df788034450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d829a69b-d740-4e4c-8301-ef09c9d45165+13:9507:x1876035733833472:12345-192.168.206.40@tcp:502:llog_process_th.0 Request processed in 250us (1073us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127320.993393:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 276 00010000:00010000:2.0:1789127321.011214:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127322.036950:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127323.059084:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127323.123598:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df78efce940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876035752746368:0@lo:400:kworker.0 00000100:00100000:0.0:1789127323.123664:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127323.123717:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df78efccf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1876035752746880:0@lo:400:kworker.0 00000100:00100000:0.0:1789127323.123742:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127323.123772:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789127323.123779:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df78efcfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3303:1876035752746240:0@lo:400:kworker.0 00000100:00100000:0.0:1789127323.123832:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127323.123851:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df78efce1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1876035752746752:0@lo:400:kworker.0 00000100:00100000:0.0:1789127323.123873:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127323.123913:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df78efcd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1876035752746496:0@lo:400:kworker.0 00000100:00100000:2.0:1789127323.124060:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752746240 00000100:00100000:2.0:1789127323.124067:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752746240 00000100:00100000:2.0:1789127323.124110:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1789127323.124119:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df788037450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:3303:x1876035752746240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127323.124169:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df788037450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:3303:x1876035752746240:12345-0@lo:400:kworker.0 Request processed in 51us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127323.124175:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1789127323.124910:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127323.125017:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789127323.125025:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df78efcde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1876035752746624:0@lo:400:kworker.0 00000100:00100000:0.0:1789127323.125062:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127323.125130:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752746880 00000100:00100000:3.0:1789127323.125136:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752746880 00000100:00100000:3.0:1789127323.125180:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752746624 00000100:00100000:3.0:1789127323.125183:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752746624 00000100:00100000:3.0:1789127323.125204:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789127323.125211:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df78efcf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1876035752746880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127323.125268:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df78efcf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1876035752746880:12345-0@lo:400:kworker.0 Request processed in 57us (1523us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127323.125274:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789127323.125289:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789127323.125309:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df78efcda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1876035752746624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127323.125343:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df78efcda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1876035752746624:12345-0@lo:400:kworker.0 Request processed in 35us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127323.125348:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:3.0:1789127323.125364:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789127323.125368:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789127323.129127:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789127323.129155:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7b4317c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1876035752747008:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789127323.129229:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127323.129493:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752746368 00000100:00100000:2.0:1789127323.129502:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752746368 00000100:00100000:2.0:1789127323.129545:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752746752 00000100:00100000:2.0:1789127323.129548:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752746752 00000100:00100000:2.0:1789127323.129569:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752746496 00000100:00100000:2.0:1789127323.129572:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752746496 00000100:00100000:2.0:1789127323.129588:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789127323.129596:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df78efcc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876035752746368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127323.129650:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df78efcc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876035752746368:12345-0@lo:400:kworker.0 Request processed in 55us (5986us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127323.129658:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789127323.129674:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789127323.129679:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df78efcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876035752746752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127323.129706:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df78efcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876035752746752:12345-0@lo:400:kworker.0 Request processed in 27us (5832us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127323.129725:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789127323.129737:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789127323.129742:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df78efcc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876035752746496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127323.129771:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df78efcc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876035752746496:12345-0@lo:400:kworker.0 Request processed in 29us (5823us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127323.129776:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:2.0:1789127323.129860:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789127323.136576:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752747008 00000100:00100000:3.0:1789127323.136590:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752747008 00000100:00100000:3.0:1789127323.136653:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789127323.136662:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bbd852c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876035752747008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789127323.136700:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789127323.136780:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bbd852c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876035752747008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (7551us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127323.136804:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:3.0:1789127323.136851:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df7b4317c00 x1876035752747008/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127339 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127323.136871:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7b4317c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1876035752747008:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1789127323.138912:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df78efcde00 x1876035752746624/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127339 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127323.138929:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df78efcde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1876035752746624:0@lo:400:kworker.0 00000100:00100000:3.0:1789127323.138963:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df78efcd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1876035752746496:0@lo:400:kworker.0 00000100:00100000:0.0:1789127323.141381:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df78efcfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3303:1876035752746240:0@lo:400:kworker.0 00000100:00100000:0.0:1789127323.141403:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df78efce1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1876035752746752:0@lo:400:kworker.0 00000100:00100000:0.0:1789127323.141414:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df78efce940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876035752746368:0@lo:400:kworker.0 00010000:00080000:0.0:1789127323.141428:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df78efccf00 x1876035752746880/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127339 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127323.141438:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df78efccf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1876035752746880:0@lo:400:kworker.0 00000100:00100000:3.0:1789127323.880655:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127323.880700:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127323.880737:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127323.880771:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733833728 00000100:00100000:3.0:1789127323.880817:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733833728 00000100:00100000:3.0:1789127323.880880:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733833856 00000100:00100000:3.0:1789127323.880884:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733833856 00000100:00100000:3.0:1789127323.880908:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 104 00000100:00100000:3.0:1789127323.880917:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b4317c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+6:2349:x1876035733833728:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:3.0:1789127323.881003:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b4317c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+6:2349:x1876035733833728:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 87us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127323.881011:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 104 00000100:00100000:3.0:1789127323.881028:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 105 00000100:00100000:3.0:1789127323.881034:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b4316d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81b0e267-d7e0-4043-b34e-eec2dc4c5a6b+5:2349:x1876035733833856:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:3.0:1789127323.881058:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b4316d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81b0e267-d7e0-4043-b34e-eec2dc4c5a6b+5:2349:x1876035733833856:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 25us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127323.881412:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 105 00000100:00100000:0.0:1789127323.881582:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733833600 00000100:00100000:0.0:1789127323.881587:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733833600 00000100:00100000:0.0:1789127323.881625:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 278 00000100:00100000:0.0:1789127323.881632:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df788037850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d829a69b-d740-4e4c-8301-ef09c9d45165+13:2349:x1876035733833600:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:0.0:1789127323.881668:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df788037850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d829a69b-d740-4e4c-8301-ef09c9d45165+13:2349:x1876035733833600:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 36us (966us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127323.881674:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 278 00000100:00080000:2.0:1789127323.881887:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789127324.082938:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127324.148532:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789127324.148555:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7bbd84f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1876035752747136:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789127324.148623:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127324.148853:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752747136 00000100:00100000:1.0:1789127324.148861:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752747136 00000100:00100000:1.0:1789127324.148913:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789127324.148923:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df78efce940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876035752747136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789127324.148957:0:10333:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789127324.149026:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df78efce940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876035752747136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127324.149034:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:0.0:1789127324.149114:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df7bbd84f00 x1876035752747136/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127340 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127324.149201:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7bbd84f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1876035752747136:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1789127324.977251:0:11818:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 07:48:42 (1789127322) === 00010000:00010000:0.0:1789127325.107957:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127326.131035:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127326.633584:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127326.635206:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733833984 00000100:00100000:3.0:1789127326.635220:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733833984 00000100:00100000:3.0:1789127326.635314:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 14 00000100:00100000:3.0:1789127326.635328:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df78efce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+6:2346:x1876035733833984:12345-192.168.206.40@tcp:41:mkdir.0 00000004:00000024:3.0:1789127326.635368:0:5832:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789127326.635393:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127326.635450:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733834112 00000100:00100000:0.0:1789127326.635459:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733834112 00000100:00100000:3.0:1789127326.635466:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df78efce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+7:2346:x1876035733833984:12345-192.168.206.40@tcp:41:mkdir.0 Request processed in 139us (1895us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127326.635476:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 14 00000100:00100000:0.0:1789127326.635523:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 0 00000100:00100000:0.0:1789127326.635535:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df78efcfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:28762f98-a240-4662-a754-e28bbeb6cb4b+6:9874:x1876035733834112:12345-192.168.206.40@tcp:700:mkdir.0 00000100:00100000:0.0:1789127326.635612:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df78efcfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:28762f98-a240-4662-a754-e28bbeb6cb4b+6:9874:x1876035733834112:12345-192.168.206.40@tcp:700:mkdir.0 Request processed in 74us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127326.635619:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 0 00000100:00080000:1.0:1789127326.635637:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789127326.639355:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127326.640354:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733834368 00000100:00100000:3.0:1789127326.640368:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733834368 00000100:00100000:3.0:1789127326.640435:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 15 00000100:00100000:3.0:1789127326.640445:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df78efcd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+6:9874:x1876035733834368:12345-192.168.206.40@tcp:36:mkdir.0 00010000:00010000:3.0:1789127326.640497:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127326.640576:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df780031000/0xeeacf7c0243003d9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b79ec expref: 6 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127326.640593:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df782a68700) 00010000:00010000:3.0:1789127326.640604:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789127326.640988:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c024300537 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127326.641003:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c024300537 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127326.641012:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c024300537 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127326.641039:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c02430053e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127326.641046:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c02430053e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127326.641051:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c02430053e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789127326.642256:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:3.0:1789127326.642271:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c024300537 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127326.642279:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c024300537 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127326.642285:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c024300537 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127326.642300:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df798df1e00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:3.0:1789127326.642305:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c024300537 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127326.642313:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c024300537 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127326.642326:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df79f06c300) 00010000:00010000:3.0:1789127326.642329:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127326.642334:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c024300537 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127326.642339:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c024300537 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789127326.642356:0:5830:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000001741a6de reply state 0000000064918486 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c02430053e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127326.642364:0:5830:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789127326.642452:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df78efcd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+7:9874:x1876035733834368:12345-192.168.206.40@tcp:36:mkdir.0 Request processed in 2006us (3108us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1789127326.642461:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 15 00010000:00010000:0.0:1789127326.652138:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c02430053e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127326.652156:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c02430053e lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127326.652164:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c02430053e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127326.652170:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df798df0200 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:0.0:1789127326.652174:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c02430053e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127326.652182:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c02430053e lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127326.652198:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8df79f06cc00) 00010000:00010000:0.0:1789127326.652201:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127326.652206:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c02430053e lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127326.652212:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c02430053e lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127326.681358:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127326.681452:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733834496 00000100:00100000:3.0:1789127326.681460:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733834496 00000100:00100000:3.0:1789127326.681517:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 16 00000100:00100000:3.0:1789127326.681526:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df682c712c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+6:9875:x1876035733834496:12345-192.168.206.40@tcp:101:chmod.0 00010000:00010000:3.0:1789127326.681546:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127326.681578:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c024300545 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7a7f expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127326.681655:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1000/0xeeacf7c02430054c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127326.681668:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1000/0xeeacf7c02430054c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127326.681679:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1000/0xeeacf7c02430054c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789127326.681735:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1789127326.681739:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1789127326.681782:0:5832:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1000/0xeeacf7c02430054c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127326.681839:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c024300545 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7a7f expref: 8 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127326.681856:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1000/0xeeacf7c02430054c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7a7f expref: 7 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127326.681864:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df79f06c300) 00010000:00010000:3.0:1789127326.681867:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789127326.681871:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df798df1000, rc 0) 00000100:00100000:3.0:1789127326.681926:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df682c712c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+7:9875:x1876035733834496:12345-192.168.206.40@tcp:101:chmod.0 Request processed in 400us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127326.683367:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 16 00000100:00100000:2.0:1789127326.693096:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127326.696119:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733834752 00000100:00100000:0.0:1789127326.696132:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733834752 00000100:00100000:0.0:1789127326.696185:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 17 00000100:00100000:0.0:1789127326.696195:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df682c70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+7:9875:x1876035733834752:12345-192.168.206.40@tcp:36:chmod.0 00010000:00010000:0.0:1789127326.696247:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789127326.696279:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1000/0xeeacf7c02430054c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7a7f expref: 7 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127326.696318:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df79f06c300) 00010000:00010000:0.0:1789127326.696332:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789127326.696380:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728000/0xeeacf7c024300553 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127326.696393:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728000/0xeeacf7c024300553 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127326.696405:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728000/0xeeacf7c024300553 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789127326.696771:0:5830:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000023465771 reply state 00000000fea7be11 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728000/0xeeacf7c024300553 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127326.696780:0:5830:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789127326.696816:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1789127326.696984:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df682c70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+8:9875:x1876035733834752:12345-192.168.206.40@tcp:36:chmod.0 Request processed in 790us (3896us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1789127326.696992:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 17 00010000:00010000:3.0:1789127326.703157:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728000/0xeeacf7c024300553 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127326.703185:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728000/0xeeacf7c024300553 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127326.703192:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728000/0xeeacf7c024300553 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127326.703198:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7ae728000 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:3.0:1789127326.703202:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728000/0xeeacf7c024300553 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127326.703210:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728000/0xeeacf7c024300553 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127326.703225:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df782a68f00) 00010000:00010000:3.0:1789127326.703228:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789127326.703233:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728000/0xeeacf7c024300553 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127326.703239:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728000/0xeeacf7c024300553 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127326.765454:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127326.765605:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733834880 00000100:00100000:3.0:1789127326.765615:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733834880 00000100:00100000:3.0:1789127326.765673:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 18 00000100:00100000:3.0:1789127326.765684:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df682c71680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+7:9876:x1876035733834880:12345-192.168.206.40@tcp:101:chown.0 00010000:00010000:3.0:1789127326.765707:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127326.765730:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c02430055a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7a86 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127326.765830:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0e00/0xeeacf7c024300561 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127326.765856:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0e00/0xeeacf7c024300561 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127326.765867:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0e00/0xeeacf7c024300561 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789127326.765923:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1789127326.765939:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1789127326.766396:0:5832:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0e00/0xeeacf7c024300561 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127326.766424:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c02430055a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7a86 expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127326.766439:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0e00/0xeeacf7c024300561 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7a86 expref: 8 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127326.766448:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df79f06c000) 00010000:00010000:0.0:1789127326.766457:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789127326.766461:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df798df0e00, rc 0) 00000100:00100000:0.0:1789127326.766518:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df682c71680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+8:9876:x1876035733834880:12345-192.168.206.40@tcp:101:chown.0 Request processed in 836us (1085us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127326.766526:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 18 00000100:00100000:1.0:1789127326.772507:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127326.772588:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733835008 00000100:00100000:0.0:1789127326.772597:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733835008 00000100:00100000:0.0:1789127326.772651:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 19 00000100:00100000:0.0:1789127326.772661:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79a3a2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+8:9876:x1876035733835008:12345-192.168.206.40@tcp:101:chown.0 00010000:00010000:0.0:1789127326.772681:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127326.772702:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729800/0xeeacf7c024300568 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7a8d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127326.772761:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c02430056f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127326.772775:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c02430056f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127326.772815:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c02430056f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127326.772831:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728200/0xeeacf7c024300576 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127326.772838:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728200/0xeeacf7c024300576 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127326.772845:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728200/0xeeacf7c024300576 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127326.773138:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728a00/0xeeacf7c02430057d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127326.773147:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728a00/0xeeacf7c02430057d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127326.773154:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728a00/0xeeacf7c02430057d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789127326.773191:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:0.0:1789127326.773194:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789127326.773216:0:5830:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728a00/0xeeacf7c02430057d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127326.773227:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c02430056f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127326.773233:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c02430056f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127326.773240:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c02430056f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127326.773245:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7ae729c00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:0.0:1789127326.773248:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c02430056f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127326.773255:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c02430056f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127326.773266:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df79f06c000) 00010000:00010000:0.0:1789127326.773275:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127326.773280:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c02430056f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127326.773286:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c02430056f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127326.773300:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728200/0xeeacf7c024300576 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127326.773305:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728200/0xeeacf7c024300576 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127326.773311:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728200/0xeeacf7c024300576 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127326.773315:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7ae728200 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:0.0:1789127326.773318:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728200/0xeeacf7c024300576 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127326.773323:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728200/0xeeacf7c024300576 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127326.773330:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8df782a68e00) 00010000:00010000:0.0:1789127326.773333:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127326.773336:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728200/0xeeacf7c024300576 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127326.773341:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728200/0xeeacf7c024300576 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127326.773373:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729800/0xeeacf7c024300568 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7a8d expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127326.773400:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728a00/0xeeacf7c02430057d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7a8d expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127326.773407:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8df782a68900) 00010000:00010000:0.0:1789127326.773409:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789127326.773412:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7ae728a00, rc 0) 00000100:00100000:0.0:1789127326.773483:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79a3a2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+9:9876:x1876035733835008:12345-192.168.206.40@tcp:101:chown.0 Request processed in 823us (985us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127326.773490:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 19 00000100:00100000:2.0:1789127326.776834:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127326.776933:0:10285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733835264 00000100:00100000:1.0:1789127326.776941:0:10285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733835264 00000100:00100000:1.0:1789127326.777006:0:10285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 20 00000100:00100000:1.0:1789127326.777015:0:10285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df682c72d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+9:9876:x1876035733835264:12345-192.168.206.40@tcp:36:chown.0 00010000:00010000:1.0:1789127326.777065:0:10285:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789127326.777091:0:10285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728a00/0xeeacf7c02430057d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7a8d expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127326.777109:0:10285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8df782a68900) 00010000:00010000:1.0:1789127326.777131:0:10285:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789127326.777156:0:10285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c024300584 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127326.777168:0:10285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c024300584 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127326.777178:0:10285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c024300584 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789127326.820836:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000001:00080000:2.0:1789127326.820856:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:1.0:1789127326.821146:0:10285:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000d9adf9a6 reply state 000000008fa1a05d transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c024300584 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127326.821161:0:10285:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789127326.821311:0:10285:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:1.0:1789127326.821409:0:10285:0:(ldlm_lib.c:3520:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1789127326.821430:0:10285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df682c72d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+7:9876:x1876035733835264:12345-192.168.206.40@tcp:36:chown.0 Request processed in 44412us (44642us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1789127326.821439:0:10285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 20 00010000:00010000:0.0:1789127326.821515:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c024300584 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127326.821525:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c024300584 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127326.821533:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c024300584 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127326.821539:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd96600 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:0.0:1789127326.821544:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c024300584 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127326.821553:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c024300584 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127326.821570:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8df782d66e00) 00010000:00010000:0.0:1789127326.821574:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789127326.821578:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c024300584 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127326.821674:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c024300584 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127326.863246:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127326.863321:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733835392 00000100:00100000:1.0:1789127326.863330:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733835392 00000100:00100000:1.0:1789127326.863392:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 21 00000100:00100000:1.0:1789127326.863402:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df682c73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+6:9877:x1876035733835392:12345-192.168.206.40@tcp:101:touch.500 00010000:00010000:1.0:1789127326.863423:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127326.863562:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97200/0xeeacf7c02430058b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7a94 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789127326.869996:0:5831:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 6299us 00010000:00010000:1.0:1789127326.899579:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024300592 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127326.900088:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024300592 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127326.900119:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024300592 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127326.900140:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c024300599 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127326.900148:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c024300599 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127326.900154:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c024300599 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127326.902373:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c0243005a0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127326.902391:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c0243005a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127326.902403:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c0243005a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789127326.902482:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1789127326.902486:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789127326.902577:0:5831:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c0243005a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127326.902603:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024300592 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127326.902610:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024300592 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127326.902629:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024300592 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127326.902634:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd97e00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:1.0:1789127326.902637:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024300592 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127326.902644:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024300592 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127326.902656:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df79f06c000) 00010000:00010000:1.0:1789127326.902659:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789127326.902663:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024300592 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127326.902670:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024300592 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127326.902682:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c024300599 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127326.902688:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c024300599 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127326.902695:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c024300599 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127326.902701:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd96600 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:1.0:1789127326.902704:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c024300599 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127326.902719:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c024300599 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127326.902728:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8df782d66800) 00010000:00010000:1.0:1789127326.902731:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789127326.902734:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c024300599 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127326.902739:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c024300599 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127326.902777:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97200/0xeeacf7c02430058b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7a94 expref: 8 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127326.902934:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c0243005a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7a94 expref: 7 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127326.902943:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8df782d66c00) 00010000:00010000:1.0:1789127326.902946:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789127326.902948:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7bbd96a00, rc 0) 00000100:00100000:1.0:1789127326.903092:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df682c73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+7:9877:x1876035733835392:12345-192.168.206.40@tcp:101:touch.500 Request processed in 39689us (39854us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127326.903102:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 21 00000100:00100000:2.0:1789127326.906168:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127326.906352:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733835648 00000100:00100000:1.0:1789127326.906362:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733835648 00000100:00100000:1.0:1789127326.906414:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 22 00000100:00100000:1.0:1789127326.906423:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df682c70f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+7:9877:x1876035733835648:12345-192.168.206.40@tcp:101:touch.500 00010000:00010000:1.0:1789127326.906458:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127326.906480:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96200/0xeeacf7c0243005a7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7a9b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127326.906774:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c0243005ae lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127326.906818:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c0243005ae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127326.906830:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c0243005ae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127326.906845:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97a00/0xeeacf7c0243005b5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127326.906853:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97a00/0xeeacf7c0243005b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127326.907138:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97a00/0xeeacf7c0243005b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789127326.908423:0:5832:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:1.0:1789127326.908699:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c0243005bc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127326.908713:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c0243005bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127326.908723:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c0243005bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127326.908770:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c0243005ae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127326.908777:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c0243005ae lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127326.908783:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c0243005ae lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127326.909360:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd97800 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:1.0:1789127326.909365:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c0243005ae lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127326.909374:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c0243005ae lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127326.909387:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8df782d66c00) 00010000:00010000:1.0:1789127326.909390:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789127326.909395:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c0243005ae lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127326.909401:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c0243005ae lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789127326.909416:0:5832:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000000ecde6ac reply state 00000000939cc655 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97a00/0xeeacf7c0243005b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127326.909424:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789127326.909465:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96200/0xeeacf7c0243005a7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7a9b expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127326.909493:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c0243005bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7a9b expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127326.909501:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8df782d66b00) 00010000:00010000:1.0:1789127326.909503:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789127326.909506:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7bbd96000, rc 0) 00000100:00100000:1.0:1789127326.909599:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df682c70f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+10:9877:x1876035733835648:12345-192.168.206.40@tcp:101:touch.500 Request processed in 3176us (3440us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1789127326.909609:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 22 00010000:00010000:0.0:1789127326.921914:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97a00/0xeeacf7c0243005b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127326.921944:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97a00/0xeeacf7c0243005b5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127326.921962:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97a00/0xeeacf7c0243005b5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127326.921970:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd97a00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:0.0:1789127326.921975:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97a00/0xeeacf7c0243005b5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127326.921983:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97a00/0xeeacf7c0243005b5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127326.922001:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x1b3b195e (ffff8df782d66e00) 00010000:00010000:0.0:1789127326.922004:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127326.922009:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97a00/0xeeacf7c0243005b5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127326.922016:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97a00/0xeeacf7c0243005b5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127326.933214:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127326.933324:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733835904 00000100:00100000:0.0:1789127326.933334:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733835904 00000100:00100000:0.0:1789127326.933394:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 23 00000100:00100000:0.0:1789127326.933404:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df682c73c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+9:9877:x1876035733835904:12345-192.168.206.40@tcp:36:touch.500 00010000:00010000:0.0:1789127326.933469:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789127326.933496:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c0243005bc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7a9b expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127326.933514:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8df782d66b00) 00010000:00010000:0.0:1789127326.933524:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789127326.933579:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729800/0xeeacf7c0243005ca lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127326.933598:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729800/0xeeacf7c0243005ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127326.933608:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729800/0xeeacf7c0243005ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789127326.933722:0:5830:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000f0bf06f0 reply state 000000009fe4a021 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729800/0xeeacf7c0243005ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127326.933731:0:5830:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789127326.933837:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df682c73c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+10:9877:x1876035733835904:12345-192.168.206.40@tcp:36:touch.500 Request processed in 434us (988us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1789127326.933844:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 23 00010000:00010000:3.0:1789127326.943159:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729800/0xeeacf7c0243005ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127326.943177:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729800/0xeeacf7c0243005ca lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127326.943186:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729800/0xeeacf7c0243005ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127326.943192:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7ae729800 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:3.0:1789127326.943197:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729800/0xeeacf7c0243005ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127326.943205:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729800/0xeeacf7c0243005ca lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127326.943222:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8df782a68600) 00010000:00010000:3.0:1789127326.943225:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127326.943230:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729800/0xeeacf7c0243005ca lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127326.943237:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729800/0xeeacf7c0243005ca lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127326.951326:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127326.951415:0:10285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733836032 00000100:00100000:3.0:1789127326.951424:0:10285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733836032 00000100:00100000:3.0:1789127326.951485:0:10285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 24 00000100:00100000:3.0:1789127326.951494:0:10285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df682c71a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+9:9877:x1876035733836032:12345-192.168.206.40@tcp:101:touch.500 00010000:00010000:3.0:1789127326.951517:0:10285:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127326.951540:0:10285:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1200/0xeeacf7c0243005d1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7aa2 expref: -99 pid: 10285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127326.951612:0:10285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1200/0xeeacf7c0243005d1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7aa2 expref: 10 pid: 10285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127326.951626:0:10285:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1200/0xeeacf7c0243005d1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7aa2 expref: 10 pid: 10285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127326.951646:0:10285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8df79f06c600) 00010000:00010000:3.0:1789127326.951649:0:10285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789127326.951653:0:10285:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df798df1200, rc 0) 00000100:00100000:3.0:1789127326.951719:0:10285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df682c71a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+10:9877:x1876035733836032:12345-192.168.206.40@tcp:101:touch.500 Request processed in 225us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127326.951726:0:10285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 24 00000100:00100000:1.0:1789127326.967571:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127326.967663:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733836160 00000100:00100000:3.0:1789127326.967672:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733836160 00000100:00100000:3.0:1789127326.967717:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 16 00000100:00100000:3.0:1789127326.967725:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79a3a12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2345:x1876035733836160:12345-192.168.206.40@tcp:8:touch.500 00010000:00080000:3.0:1789127326.967756:0:6688:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 28762f98-a240-4662-a754-e28bbeb6cb4b@192.168.206.40@tcp t0 exp 0000000000000000 cur 273 last 0 00000020:00000080:3.0:1789127326.967824:0:6688:0:(genops.c:1385:class_connect()) connect: client 28762f98-a240-4662-a754-e28bbeb6cb4b, cookie 0xeeacf7c0243005d8 00002000:00100000:3.0:1789127326.967849:0:6688:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 28762f98-a240-4662-a754-e28bbeb6cb4b/ffff8df78803b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113987 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789127326.967873:0:6688:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789127326.968132:0:6688:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789127326.968162:0:6688:0:(import.c:65:import_set_state_nolock()) ffff8df78803f000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789127326.968233:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79a3a12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+6:2345:x1876035733836160:12345-192.168.206.40@tcp:8:touch.500 Request processed in 506us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127326.968240:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 16 00000100:00100000:0.0:1789127326.978168:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127326.978298:0:8063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733836288 00000100:00100000:1.0:1789127326.978307:0:8063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733836288 00000100:00100000:1.0:1789127326.978379:0:8063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 17 00000100:00100000:1.0:1789127326.978389:0:8063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df78efccf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+6:0:x1876035733836288:12345-192.168.206.40@tcp:2:touch.500 00000100:00080000:2.0:1789127326.978697:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1789127327.018146:0:7646:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:3.0:1789127327.022094:0:8063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df78efccf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+6:0:x1876035733836288:12345-192.168.206.40@tcp:2:touch.500 Request processed in 43697us (43925us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1789127327.022108:0:8063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 17 00000001:00100000:0.0:1789127327.022506:0:7646:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 28762f98-a240-4662-a754-e28bbeb6cb4b 00000100:00100000:3.0:1789127327.024367:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127327.024684:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733836544 00000100:00100000:0.0:1789127327.024694:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733836544 00000100:00100000:0.0:1789127327.024747:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 2 00000100:00100000:0.0:1789127327.024756:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b43161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+10:9877:x1876035733836544:12345-192.168.206.40@tcp:35:touch.500 00000100:00100000:0.0:1789127327.025314:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b43161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+11:9877:x1876035733836544:12345-192.168.206.40@tcp:35:touch.500 Request processed in 555us (952us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1789127327.025322:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 2 00000100:00100000:1.0:1789127327.062989:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127327.063146:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733836672 00000100:00100000:0.0:1789127327.063155:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733836672 00000100:00100000:0.0:1789127327.063209:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 25 00000100:00100000:0.0:1789127327.063218:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79062a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+11:9878:x1876035733836672:12345-192.168.206.40@tcp:101:rm.0 00010000:00010000:0.0:1789127327.063240:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127327.063260:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c0243005df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7aa9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127327.063314:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c0243005e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127327.063328:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c0243005e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127327.063339:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c0243005e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789127327.063395:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1789127327.063398:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1789127327.063436:0:5830:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c0243005e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127327.063459:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c0243005df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7aa9 expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127327.063478:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c0243005e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7aa9 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127327.063499:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8df782d66c00) 00010000:00010000:0.0:1789127327.063502:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789127327.063505:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7ae729e00, rc 0) 00000100:00100000:0.0:1789127327.063563:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79062a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+12:9878:x1876035733836672:12345-192.168.206.40@tcp:101:rm.0 Request processed in 345us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127327.063569:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 25 00000100:00100000:3.0:1789127327.069563:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127327.069660:0:10285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733836928 00000100:00100000:1.0:1789127327.069668:0:10285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733836928 00000100:00100000:1.0:1789127327.069727:0:10285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 26 00000100:00100000:1.0:1789127327.069737:0:10285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b4317480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+12:9878:x1876035733836928:12345-192.168.206.40@tcp:101:rm.0 00010000:00010000:1.0:1789127327.069756:0:10285:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127327.069776:0:10285:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c0243005ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7ab0 expref: -99 pid: 10285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789127327.070185:0:10285:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1789127327.070341:0:10285:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c0243005ed lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7ab0 expref: 14 pid: 10285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127327.070362:0:10285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df79f06c000) 00010000:00010000:1.0:1789127327.070365:0:10285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789127327.070371:0:10285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c0243005ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7ab0 expref: 14 pid: 10285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127327.070384:0:10285:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7bbd97800, rc 0) 00000100:00100000:1.0:1789127327.070497:0:10285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b4317480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+13:9878:x1876035733836928:12345-192.168.206.40@tcp:101:rm.0 Request processed in 761us (943us total) trans 4294967303 rc 301/301 00000100:00100000:1.0:1789127327.070506:0:10285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 26 00000100:00100000:0.0:1789127327.079335:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127327.079624:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733837056 00000100:00100000:3.0:1789127327.079634:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733837056 00000100:00100000:3.0:1789127327.079689:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 3 00000100:00100000:3.0:1789127327.079700:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df78efcd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+13:9878:x1876035733837056:12345-192.168.206.40@tcp:37:rm.0 00000100:00100000:0.0:1789127327.084585:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df78efcd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+13:9878:x1876035733837056:12345-192.168.206.40@tcp:37:rm.0 Request processed in 4875us (5247us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127327.084598:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 3 00000100:00100000:3.0:1789127327.097527:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127327.097660:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733837312 00000100:00100000:0.0:1789127327.097671:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733837312 00000100:00100000:0.0:1789127327.097731:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 4 00000100:00100000:0.0:1789127327.097743:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df791568450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+13:9878:x1876035733837312:12345-192.168.206.40@tcp:35:rm.0 00000100:00100000:0.0:1789127327.098227:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df791568450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+14:9878:x1876035733837312:12345-192.168.206.40@tcp:35:rm.0 Request processed in 483us (706us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1789127327.098236:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 4 00000100:00100000:0.0:1789127327.102163:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127327.102323:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733837568 00000100:00100000:3.0:1789127327.102332:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733837568 00000100:00100000:3.0:1789127327.102390:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 27 00000100:00100000:3.0:1789127327.102400:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df78efcd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+14:9878:x1876035733837568:12345-192.168.206.40@tcp:101:rm.0 00010000:00010000:3.0:1789127327.102424:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127327.102444:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c0243005fb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7ab7 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127327.102557:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1000/0xeeacf7c024300602 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127327.102583:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1000/0xeeacf7c024300602 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127327.102594:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1000/0xeeacf7c024300602 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789127327.102607:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1789127327.102726:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c0243005fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7ab7 expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127327.102744:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1000/0xeeacf7c024300602 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7ab7 expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127327.102753:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8df782d66c00) 00010000:00010000:3.0:1789127327.102756:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789127327.102760:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df798df1000, rc 0) 00000100:00100000:3.0:1789127327.102856:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df78efcd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+16:9878:x1876035733837568:12345-192.168.206.40@tcp:101:rm.0 Request processed in 458us (702us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1789127327.102864:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 27 00000100:00100000:2.0:1789127327.114660:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127327.114752:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733837696 00000100:00100000:0.0:1789127327.114762:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733837696 00000100:00100000:0.0:1789127327.114842:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 28 00000100:00100000:0.0:1789127327.114853:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bbd84f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+16:9878:x1876035733837696:12345-192.168.206.40@tcp:41:rm.0 00000004:00000024:0.0:1789127327.114909:0:5832:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:0.0:1789127327.115156:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bbd84f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+16:9878:x1876035733837696:12345-192.168.206.40@tcp:41:rm.0 Request processed in 304us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127327.115174:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 28 00000100:00100000:0.0:1789127327.124160:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127327.124322:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733837824 00000100:00100000:3.0:1789127327.124331:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733837824 00000100:00100000:3.0:1789127327.124387:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 29 00000100:00100000:3.0:1789127327.124397:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df78efcde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+16:9878:x1876035733837824:12345-192.168.206.40@tcp:101:rm.0 00010000:00010000:3.0:1789127327.124417:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127327.124436:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c024300610 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7abe expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127327.124517:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024300617 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127327.124532:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024300617 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127327.124543:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024300617 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127327.124558:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173200/0xeeacf7c02430061e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127327.124564:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173200/0xeeacf7c02430061e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127327.124570:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173200/0xeeacf7c02430061e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127327.124674:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173e00/0xeeacf7c024300625 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127327.124682:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173e00/0xeeacf7c024300625 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127327.124688:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173e00/0xeeacf7c024300625 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789127327.124713:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:3.0:1789127327.124717:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789127327.124733:0:5830:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173e00/0xeeacf7c024300625 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127327.124757:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173e00/0xeeacf7c024300625 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127327.124764:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024300617 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127327.124770:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024300617 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127327.124777:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024300617 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127327.124783:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df798df0200 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:3.0:1789127327.124820:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024300617 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127327.124828:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024300617 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127327.124840:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8df782d66c00) 00010000:00010000:3.0:1789127327.124844:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127327.124849:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024300617 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127327.124854:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024300617 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127327.124868:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173200/0xeeacf7c02430061e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127327.124874:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173200/0xeeacf7c02430061e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127327.124885:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173200/0xeeacf7c02430061e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127327.124890:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7c2173200 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:3.0:1789127327.124892:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173200/0xeeacf7c02430061e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127327.124898:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173200/0xeeacf7c02430061e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127327.124905:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x1b3b195e (ffff8df79f06c100) 00010000:00010000:3.0:1789127327.124907:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127327.124910:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173200/0xeeacf7c02430061e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127327.124915:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173200/0xeeacf7c02430061e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127327.125163:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c024300610 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7abe expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127327.125179:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173e00/0xeeacf7c024300625 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7abe expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127327.125186:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8df79f06c600) 00010000:00010000:3.0:1789127327.125188:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789127327.125190:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7c2173e00, rc 0) 00000100:00100000:3.0:1789127327.125246:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df78efcde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+17:9878:x1876035733837824:12345-192.168.206.40@tcp:101:rm.0 Request processed in 850us (1094us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127327.125262:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 29 00000100:00100000:2.0:1789127327.128282:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127327.128379:0:10285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733838080 00000100:00100000:1.0:1789127327.128388:0:10285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733838080 00000100:00100000:1.0:1789127327.128449:0:10285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 30 00000100:00100000:1.0:1789127327.128459:0:10285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79a2c5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+17:9878:x1876035733838080:12345-192.168.206.40@tcp:36:rm.0 00010000:00010000:1.0:1789127327.128506:0:10285:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789127327.128529:0:10285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173e00/0xeeacf7c024300625 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7abe expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127327.128548:0:10285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1200/0xeeacf7c0243005d1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7aa2 expref: 16 pid: 10285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127327.128560:0:10285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8df79f06c600) 00010000:00010000:1.0:1789127327.128575:0:10285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c0243005e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7aa9 expref: 15 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127327.128585:0:10285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8df782d66c00) 00010000:00010000:1.0:1789127327.128600:0:10285:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789127327.128620:0:10285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c02430062c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127327.128632:0:10285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c02430062c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127327.128642:0:10285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c02430062c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127327.128655:0:10285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97200/0xeeacf7c024300633 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127327.128663:0:10285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97200/0xeeacf7c024300633 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127327.128670:0:10285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97200/0xeeacf7c024300633 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127327.128773:0:10285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c02430063a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127327.128781:0:10285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c02430063a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127327.128831:0:10285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c02430063a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789127327.129671:0:10285:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1789127327.129683:0:10285:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 273285893616ns, next at 274285891541ns, rc = 0 00010000:00010000:1.0:1789127327.129735:0:10285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024300641 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127327.129756:0:10285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024300641 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127327.129765:0:10285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024300641 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127327.129773:0:10285:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024300641 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127327.129780:0:10285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024300641 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127327.129813:0:10285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024300641 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127327.129829:0:10285:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789127327.129848:0:10285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c02430063a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127327.129855:0:10285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c02430063a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127327.129861:0:10285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c02430063a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127327.129866:0:10285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd96600 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:1.0:1789127327.129870:0:10285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c02430063a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127327.129877:0:10285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c02430063a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127327.130464:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789127327.130472:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024300641 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127327.134072:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd97e00 already unused, calling callback (ffffffffc17a4550) 00010000:00010000:2.0:1789127327.134086:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024300641 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127327.134117:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024300641 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127327.134134:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8df782d66800) 00010000:00010000:2.0:1789127327.134138:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789127327.134142:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024300641 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127327.134148:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024300641 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127327.134168:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127327.134171:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127327.134173:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127327.136194:0:10285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8df782d66800) 00010000:00010000:1.0:1789127327.136203:0:10285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789127327.136212:0:10285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c02430063a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127327.136222:0:10285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c02430063a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127327.136255:0:10285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c02430062c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127327.136262:0:10285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c02430062c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127327.136268:0:10285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c02430062c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127327.136274:0:10285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd97800 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:1.0:1789127327.136277:0:10285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c02430062c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127327.136284:0:10285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c02430062c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127327.136296:0:10285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8df782d66c00) 00010000:00010000:1.0:1789127327.136298:0:10285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789127327.136301:0:10285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c02430062c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127327.136306:0:10285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c02430062c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789127327.136332:0:10285:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000cc1bf844 reply state 000000007669d505 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97200/0xeeacf7c024300633 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127327.136340:0:10285:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789127327.136488:0:10285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79a2c5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+16:9878:x1876035733838080:12345-192.168.206.40@tcp:36:rm.0 Request processed in 8025us (8210us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1789127327.136498:0:10285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 30 00010000:00010000:0.0:1789127327.140382:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97200/0xeeacf7c024300633 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127327.140395:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00010000:00010000:0.0:1789127327.140402:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97200/0xeeacf7c024300633 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127327.140411:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97200/0xeeacf7c024300633 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127327.140418:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd97200 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:0.0:1789127327.140423:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97200/0xeeacf7c024300633 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127327.140442:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97200/0xeeacf7c024300633 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127327.140459:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x1b3b195e (ffff8df782d66f00) 00010000:00010000:0.0:1789127327.140462:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127327.140466:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97200/0xeeacf7c024300633 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127327.140473:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97200/0xeeacf7c024300633 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127327.141408:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733838336 00000100:00100000:3.0:1789127327.141419:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733838336 00000100:00100000:3.0:1789127327.141522:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 5 00000100:00100000:3.0:1789127327.141533:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79a2c5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+15:9878:x1876035733838336:12345-192.168.206.40@tcp:35:rm.0 00000100:00100000:3.0:1789127327.141782:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79a2c5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+16:9878:x1876035733838336:12345-192.168.206.40@tcp:35:rm.0 Request processed in 250us (1399us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1789127327.141817:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 5 00000100:00100000:0.0:1789127327.144984:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127327.145045:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733838592 00000100:00100000:1.0:1789127327.145055:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733838592 00000100:00100000:1.0:1789127327.145112:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 31 00000100:00100000:1.0:1789127327.145121:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79206ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+16:9878:x1876035733838592:12345-192.168.206.40@tcp:36:rm.0 00010000:00010000:1.0:1789127327.145192:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789127327.145222:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1000/0xeeacf7c024300602 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7ab7 expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127327.145242:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c0243005a0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7a94 expref: 15 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127327.145253:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8df782d66c00) 00010000:00010000:1.0:1789127327.145269:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0e00/0xeeacf7c024300561 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7a86 expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127327.145280:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df79f06c000) 00010000:00010000:1.0:1789127327.145285:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789127327.145309:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96800/0xeeacf7c024300648 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127327.145321:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96800/0xeeacf7c024300648 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127327.145331:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96800/0xeeacf7c024300648 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127327.145350:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97400/0xeeacf7c02430064f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127327.145357:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97400/0xeeacf7c02430064f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127327.145364:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97400/0xeeacf7c02430064f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127327.145657:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c024300656 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127327.145666:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c024300656 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127327.145673:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c024300656 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789127327.146369:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1789127327.146387:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c024300656 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127327.146395:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c024300656 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127327.146401:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c024300656 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127327.146407:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd97600 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:0.0:1789127327.146411:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c024300656 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127327.146418:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c024300656 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127327.146429:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8df782d66600) 00010000:00010000:0.0:1789127327.146432:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789127327.146436:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c024300656 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127327.146442:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c024300656 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127327.146461:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96800/0xeeacf7c024300648 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127327.146468:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96800/0xeeacf7c024300648 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127327.146474:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96800/0xeeacf7c024300648 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127327.146489:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd96800 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:0.0:1789127327.146492:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96800/0xeeacf7c024300648 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127327.146499:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96800/0xeeacf7c024300648 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127327.146507:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df782d66900) 00010000:00010000:0.0:1789127327.146509:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127327.146512:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96800/0xeeacf7c024300648 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127327.146518:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96800/0xeeacf7c024300648 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789127327.146529:0:5831:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000a501d795 reply state 0000000052e6675a transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97400/0xeeacf7c02430064f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127327.146538:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789127327.146602:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79206ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+15:9878:x1876035733838592:12345-192.168.206.40@tcp:36:rm.0 Request processed in 1481us (1625us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1789127327.146611:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 31 00010000:00010000:3.0:1789127327.150163:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97400/0xeeacf7c02430064f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127327.150180:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97400/0xeeacf7c02430064f lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127327.150188:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97400/0xeeacf7c02430064f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127327.150194:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd97400 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:3.0:1789127327.150198:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97400/0xeeacf7c02430064f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127327.150206:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97400/0xeeacf7c02430064f lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127327.150222:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8df782d66700) 00010000:00010000:3.0:1789127327.150225:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127327.150231:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97400/0xeeacf7c02430064f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127327.150322:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97400/0xeeacf7c02430064f lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127327.154966:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127328.186539:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789127328.244099:0:8062:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 274400307725ns, next at 275400305786ns, rc = 0 00000100:00100000:1.0:1789127328.244184:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7b4315e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752747264:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789127328.244251:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127328.244360:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752747264 00000100:00100000:3.0:1789127328.244367:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752747264 00000100:00100000:3.0:1789127328.244419:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789127328.244427:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df790629a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876035752747264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789127328.244447:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789127328.244482:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df790629a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876035752747264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127328.244489:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:1.0:1789127328.244540:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789127328.244568:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df7b4315e00 x1876035752747264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127344 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127328.244584:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7b4315e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752747264:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789127328.250452:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6811c6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876035752747520:0@lo:400:kworker.0 00000100:00100000:1.0:1789127328.250514:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127328.250550:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789127328.250568:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6811c7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1876035752747648:0@lo:400:kworker.0 00000100:00100000:1.0:1789127328.250605:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127328.250643:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752747520 00000100:00100000:1.0:1789127328.250649:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752747520 00000100:00100000:1.0:1789127328.250685:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752747648 00000100:00100000:1.0:1789127328.250687:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752747648 00000100:00100000:1.0:1789127328.250712:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789127328.250719:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bfc49a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876035752747520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127328.250762:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bfc49a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876035752747520:12345-0@lo:400:kworker.0 Request processed in 43us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127328.250769:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789127328.250817:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789127328.250823:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bfc48780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876035752747648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127328.250854:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bfc48780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876035752747648:12345-0@lo:400:kworker.0 Request processed in 32us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127328.250860:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:1.0:1789127328.250882:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789127328.250910:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6811c7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1876035752747648:0@lo:400:kworker.0 00000100:00100000:1.0:1789127328.250920:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6811c6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876035752747520:0@lo:400:kworker.0 00000100:00100000:2.0:1789127328.250998:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7906292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3303:1876035752747392:0@lo:400:kworker.0 00000100:00100000:2.0:1789127328.251034:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127328.251065:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6811c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1876035752747904:0@lo:400:kworker.0 00000100:00100000:2.0:1789127328.251087:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127328.251106:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789127328.251111:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6811c52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1876035752747776:0@lo:400:kworker.0 00000100:00100000:2.0:1789127328.251134:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127328.251162:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752747776 00000100:00100000:2.0:1789127328.251166:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752747776 00000100:00100000:2.0:1789127328.251200:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789127328.251207:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79a2c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1876035752747776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127328.251241:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79a2c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1876035752747776:12345-0@lo:400:kworker.0 Request processed in 35us (106us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127328.251256:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:2.0:1789127328.251276:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789127328.251295:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df6811c52c0 x1876035752747776/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127344 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127328.251306:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6811c52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1876035752747776:0@lo:400:kworker.0 00000100:00100000:2.0:1789127328.251321:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752747904 00000100:00100000:2.0:1789127328.251324:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752747904 00000100:00100000:2.0:1789127328.251350:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789127328.251356:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79a2c4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876035752747904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127328.251388:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79a2c4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876035752747904:12345-0@lo:400:kworker.0 Request processed in 33us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127328.251394:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:2.0:1789127328.251408:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789127328.251423:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6811c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1876035752747904:0@lo:400:kworker.0 00000100:00100000:1.0:1789127328.251563:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752747392 00000100:00100000:1.0:1789127328.251568:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752747392 00000100:00100000:1.0:1789127328.251601:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1789127328.251608:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df788037050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:3303:x1876035752747392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127328.251653:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df788037050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:3303:x1876035752747392:12345-0@lo:400:kworker.0 Request processed in 45us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127328.251660:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1789127328.251737:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7906292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3303:1876035752747392:0@lo:400:kworker.0 00000100:00100000:0.0:1789127329.000019:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127329.000056:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127329.000100:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127329.000134:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127329.000164:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733838848 00000100:00100000:0.0:1789127329.000187:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733838848 00000100:00100000:0.0:1789127329.000241:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733839104 00000100:00100000:0.0:1789127329.000245:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733839104 00000100:00100000:0.0:1789127329.000267:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 109 00000100:00100000:1.0:1789127329.000340:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733838976 00000100:00100000:1.0:1789127329.000350:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733838976 00000100:00100000:1.0:1789127329.000379:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 52 00000100:00100000:1.0:1789127329.000389:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b4333c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+5:2348:x1876035733838976:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:1.0:1789127329.000473:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b4333c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+5:2348:x1876035733838976:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 85us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127329.000481:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 52 00000100:00100000:0.0:1789127329.000646:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b4330f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+14:2348:x1876035733838848:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:0.0:1789127329.000682:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b4330f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+14:2348:x1876035733838848:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 40us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127329.000826:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733838720 00000100:00100000:3.0:1789127329.000831:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733838720 00000100:00100000:3.0:1789127329.000856:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 280 00000100:00100000:3.0:1789127329.000864:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df788034850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d829a69b-d740-4e4c-8301-ef09c9d45165+13:2348:x1876035733838720:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:3.0:1789127329.000892:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df788034850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d829a69b-d740-4e4c-8301-ef09c9d45165+13:2348:x1876035733838720:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 29us (883us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127329.000899:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 280 00000100:00080000:3.0:1789127329.001067:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789127329.001072:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789127329.006131:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 110 00000100:00100000:2.0:1789127329.006158:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b4333480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81b0e267-d7e0-4043-b34e-eec2dc4c5a6b+5:2348:x1876035733839104:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:2.0:1789127329.006264:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b4333480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81b0e267-d7e0-4043-b34e-eec2dc4c5a6b+5:2348:x1876035733839104:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 121us (6128us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127329.006272:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 110 00000100:00100000:0.0:1789127329.008804:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 109 00010000:00010000:0.0:1789127329.204162:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127329.267435:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789127329.267457:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79062a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1876035752748032:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789127329.267522:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127329.267587:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752748032 00000100:00100000:2.0:1789127329.267604:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752748032 00000100:00100000:2.0:1789127329.267647:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789127329.267656:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7906292c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876035752748032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789127329.267686:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789127329.267727:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7906292c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876035752748032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127329.267735:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:2.0:1789127329.267908:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df79062a940 x1876035752748032/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127345 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127329.268119:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79062a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1876035752748032:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789127330.227424:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789127331.208969:0:12017:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:0.0:1789127331.253048:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789127331.916885:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:2.0:1789127331.916922:0:5852:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000004:00080000:2.0:1789127331.916955:0:5852:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000100:00100000:3.0:1789127331.917157:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789127331.917177:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7b43312c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1876035752748160:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789127331.917242:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127331.917297:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752748160 00000100:00100000:2.0:1789127331.917304:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752748160 00000100:00100000:2.0:1789127331.917370:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789127331.917378:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b43161c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1876035752748160:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789127331.917401:0:6688:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:2.0:1789127331.917436:0:6688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6aa3ea9e, atime: 0x6aa3ea9e, ctime: 0x6aa3ea9e, blocks: 0x1 00010000:00010000:2.0:1789127331.917445:0:6688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007cc680f8/0xeeacf7c02430065d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127331.917461:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=278s v=(0 0) 00010000:00010000:2.0:1789127331.917465:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127331.917470:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007cc680f8/0xeeacf7c02430065d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127331.917505:0:6688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007cc680f8/0xeeacf7c02430065d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127331.917516:0:6688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007cc680f8/0xeeacf7c02430065d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127331.917524:0:6688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007cc680f8/0xeeacf7c02430065d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127331.917538:0:6688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789127331.917591:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789127331.917598:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007cc680f8/0xeeacf7c02430065d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127331.917606:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df79032dc00 already unused, calling callback (ffffffffc17a4550) 00010000:00010000:0.0:1789127331.917610:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007cc680f8/0xeeacf7c02430065d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127331.917618:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007cc680f8/0xeeacf7c02430065d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127331.917635:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007cc680f8/0xeeacf7c02430065d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127331.917642:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007cc680f8/0xeeacf7c02430065d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127331.917669:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127331.917671:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127331.917673:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789127331.918004:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789127331.918330:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b43161c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3300:x1876035752748160:12345-0@lo:6:osp-syn-1-0.0 Request processed in 950us (1085us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1789127331.918339:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:3.0:1789127331.922805:0:3300:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8df7b43312c0/2, rc 0, transno 4294967300 00000100:00100000:3.0:1789127331.922826:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7b43312c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1876035752748160:0@lo:6:osp-syn-1-0.0 00000020:00000080:1.0:1789127332.065389:0:12066:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcbaebf440 20000000:00000080:1.0:1789127332.065406:0:12066:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8df7b4301000 uarg=0000000000000000 20000000:01000000:1.0:1789127332.065442:0:12066:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1789127332.065448:0:12066:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1789127332.065453:0:12066:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1789127332.067566:0:12067:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:1.0:1789127332.068382:0:12066:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:0.0:1789127332.075294:0:12066:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10128 00000040:00080000:0.0:1789127332.075368:0:12066:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10256 00000040:00080000:0.0:1789127332.075407:0:12066:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10480 10000000:01000000:0.0:1789127332.075423:0:12066:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789127332.075454:0:12066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8df7ae729c00/0xeeacf7c024300664 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127332.075472:0:12066:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df7ae728e00/0xeeacf7c024300506 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c0243004ff expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127332.075480:0:12066:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df7ae729000/0xeeacf7c024300514 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c02430050d expref: 18 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127332.075487:0:12066:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df79032d200/0xeeacf7c024300522 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c02430051b expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127332.075497:0:12066:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df798df1c00/0xeeacf7c024300529 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7a71 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127332.075503:0:12066:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df7bbd96400/0xeeacf7c024300530 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7a78 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127332.075511:0:12066:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8df7ae729c00/0xeeacf7c024300664 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127332.075546:0:12066:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df7bbd96400/0xeeacf7c024300530 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7a78 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127332.075567:0:12066:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df7bbd96400/0xeeacf7c024300530 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7a78 expref: 12 pid: 5825 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127332.075583:0:12066:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7b4331e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12066:1876035752748288:192.168.206.40@tcp:104: 00010000:00010000:0.0:1789127332.075691:0:12066:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df798df1c00/0xeeacf7c024300529 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7a71 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127332.075700:0:12066:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df798df1c00/0xeeacf7c024300529 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7a71 expref: 12 pid: 5824 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127332.075709:0:12066:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7b4331a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12066:1876035752748416:192.168.206.40@tcp:104: 00010000:00010000:0.0:1789127332.075749:0:12066:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df79032d200/0xeeacf7c024300522 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xeeacf7c02430051b expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127332.075758:0:12066:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df79032d200/0xeeacf7c024300522 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xeeacf7c02430051b expref: 18 pid: 5825 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127332.075768:0:12066:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7b4330000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12066:1876035752748544:0@lo:104: 00000100:00100000:0.0:1789127332.075850:0:12066:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789127332.075883:0:12066:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df7ae729000/0xeeacf7c024300514 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xeeacf7c02430050d expref: 18 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127332.075891:0:12066:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df7ae729000/0xeeacf7c024300514 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xeeacf7c02430050d expref: 18 pid: 5822 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127332.075900:0:12066:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7b4332940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12066:1876035752748672:0@lo:104: 00000100:00100000:0.0:1789127332.075920:0:12066:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789127332.075963:0:12066:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df7ae728e00/0xeeacf7c024300506 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xeeacf7c0243004ff expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127332.075972:0:12066:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df7ae728e00/0xeeacf7c024300506 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xeeacf7c0243004ff expref: 18 pid: 5824 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127332.075980:0:12066:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7b4330780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12066:1876035752748800:0@lo:104: 00000100:00100000:0.0:1789127332.076002:0:12066:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127332.076035:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752748544 00000100:00100000:0.0:1789127332.076042:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752748544 00000100:00100000:0.0:1789127332.076075:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752748672 00000100:00100000:0.0:1789127332.076077:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752748672 00000100:00100000:0.0:1789127332.076085:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752748800 00000100:00100000:0.0:1789127332.076087:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752748800 00000100:00100000:0.0:1789127332.076104:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789127332.076111:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b43303c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+5:12066:x1876035752748544:12345-0@lo:104: 00010000:00010000:0.0:1789127332.076124:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.140@tcp lock: ffff8df798df0800/0xeeacf7c02430051b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xeeacf7c024300522 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127332.076167:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789127332.076172:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b43303c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+5:12066:x1876035752748544:12345-0@lo:104: Request processed in 62us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127332.076179:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789127332.076196:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789127332.076201:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b4331680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+4:12066:x1876035752748672:12345-0@lo:104: 00010000:00010000:0.0:1789127332.076208:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.140@tcp lock: ffff8df79032c200/0xeeacf7c02430050d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xeeacf7c024300514 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127332.076238:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789127332.076244:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b4331680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+4:12066:x1876035752748672:12345-0@lo:104: Request processed in 43us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127332.076257:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789127332.076270:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789127332.076276:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b4332580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+3:12066:x1876035752748800:12345-0@lo:104: 00010000:00010000:0.0:1789127332.076283:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.140@tcp lock: ffff8df79032ca00/0xeeacf7c0243004ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xeeacf7c024300506 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127332.076314:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789127332.076319:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b4332580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+3:12066:x1876035752748800:12345-0@lo:104: Request processed in 44us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127332.076324:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:0.0:1789127332.076341:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789127332.076346:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.140@tcp lock: ffff8df798df0800/0xeeacf7c02430051b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xeeacf7c024300522 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127332.076353:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df798df0800 already unused, calling callback (ffffffffc1da1c20) 10000000:00010000:0.0:1789127332.076357:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.140@tcp lock: ffff8df798df0800/0xeeacf7c02430051b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xeeacf7c024300522 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127332.076364:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: ffff8df798df0800/0xeeacf7c02430051b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xeeacf7c024300522 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789127332.076371:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: ffff8df798df0800/0xeeacf7c02430051b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xeeacf7c024300522 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127332.076377:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789127332.076402:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.140@tcp lock: ffff8df798df0800/0xeeacf7c02430051b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c024300522 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127332.076408:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789127332.076438:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.140@tcp lock: ffff8df798df0800/0xeeacf7c02430051b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c024300522 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127332.076445:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: ffff8df798df0800/0xeeacf7c02430051b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c024300522 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127332.076460:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789127332.076463:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.140@tcp lock: ffff8df79032c200/0xeeacf7c02430050d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xeeacf7c024300514 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127332.076468:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df79032c200 already unused, calling callback (ffffffffc1da1c20) 10000000:00010000:0.0:1789127332.076471:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.140@tcp lock: ffff8df79032c200/0xeeacf7c02430050d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xeeacf7c024300514 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127332.076477:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: ffff8df79032c200/0xeeacf7c02430050d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xeeacf7c024300514 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789127332.076482:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: ffff8df79032c200/0xeeacf7c02430050d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xeeacf7c024300514 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127332.076486:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789127332.076498:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.140@tcp lock: ffff8df79032c200/0xeeacf7c02430050d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c024300514 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127332.076503:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789127332.076509:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.140@tcp lock: ffff8df79032c200/0xeeacf7c02430050d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c024300514 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127332.076514:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: ffff8df79032c200/0xeeacf7c02430050d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c024300514 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127332.076522:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789127332.076529:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.140@tcp lock: ffff8df79032ca00/0xeeacf7c0243004ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xeeacf7c024300506 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127332.076535:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df79032ca00 already unused, calling callback (ffffffffc1da1c20) 10000000:00010000:0.0:1789127332.076537:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.140@tcp lock: ffff8df79032ca00/0xeeacf7c0243004ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xeeacf7c024300506 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127332.076543:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: ffff8df79032ca00/0xeeacf7c0243004ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xeeacf7c024300506 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789127332.076549:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: ffff8df79032ca00/0xeeacf7c0243004ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xeeacf7c024300506 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127332.076554:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789127332.076568:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.140@tcp lock: ffff8df79032ca00/0xeeacf7c0243004ff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c024300506 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127332.076573:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789127332.076587:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.140@tcp lock: ffff8df79032ca00/0xeeacf7c0243004ff lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c024300506 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127332.076593:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: ffff8df79032ca00/0xeeacf7c0243004ff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c024300506 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127332.076605:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127332.076607:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127332.076609:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127332.076614:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127332.076619:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127332.076636:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7b4333840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3302:1876035752748928:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789127332.076664:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127332.076690:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789127332.076696:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7b4330b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3302:1876035752749056:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789127332.076716:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127332.076739:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789127332.076746:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7b4332d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3301:1876035752749184:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789127332.076780:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127332.076831:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752748928 00000100:00100000:0.0:1789127332.076836:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752748928 00010000:00010000:0.0:1789127332.076853:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df79032d200/0xeeacf7c024300522 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xeeacf7c02430051b expref: 19 pid: 5825 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127332.076870:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752749056 00000100:00100000:0.0:1789127332.076873:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752749056 00010000:00010000:0.0:1789127332.076882:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df7ae729000/0xeeacf7c024300514 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xeeacf7c02430050d expref: 20 pid: 5822 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127332.076892:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752749184 00000100:00100000:0.0:1789127332.076894:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752749184 00010000:00010000:0.0:1789127332.076902:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df7ae728e00/0xeeacf7c024300506 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xeeacf7c0243004ff expref: 21 pid: 5824 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127332.076913:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789127332.076918:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b43321c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+21:3302:x1876035752748928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789127332.076943:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789127332.076948:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df79032d200/0xeeacf7c024300522 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xeeacf7c02430051b expref: 21 pid: 5825 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127332.076957:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df79032d200/0xeeacf7c024300522 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xeeacf7c02430051b expref: 21 pid: 5825 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127332.076973:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789127332.077003:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b43321c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+21:3302:x1876035752748928:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127332.077010:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789127332.077023:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789127332.077029:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b43330c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+20:3302:x1876035752749056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789127332.077036:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789127332.077040:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df7ae729000/0xeeacf7c024300514 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xeeacf7c02430050d expref: 20 pid: 5822 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127332.077048:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df7ae729000/0xeeacf7c024300514 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xeeacf7c02430050d expref: 20 pid: 5822 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127332.077058:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789127332.077075:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b43330c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+20:3302:x1876035752749056:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127332.077081:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789127332.077092:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789127332.077097:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae058b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:3301:x1876035752749184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789127332.077105:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789127332.077109:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df7ae728e00/0xeeacf7c024300506 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xeeacf7c0243004ff expref: 19 pid: 5824 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127332.077116:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df7ae728e00/0xeeacf7c024300506 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xeeacf7c0243004ff expref: 19 pid: 5824 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127332.077144:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789127332.077169:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae058b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:3301:x1876035752749184:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127332.077175:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789127332.077211:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7b4332d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3301:1876035752749184:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789127332.077235:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7b4330b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3302:1876035752749056:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789127332.077242:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7b4333840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3302:1876035752748928:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789127332.077260:0:12066:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7ae62db40 going to sleep for 11 seconds 00010000:00010000:0.0:1789127332.077272:0:12066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df79032d200/0xeeacf7c024300522 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xeeacf7c02430051b expref: 18 pid: 5825 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127332.077282:0:12066:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7b4330000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12066:1876035752748544:0@lo:104: 00010000:00010000:0.0:1789127332.077290:0:12066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df7ae729000/0xeeacf7c024300514 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xeeacf7c02430050d expref: 17 pid: 5822 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127332.077297:0:12066:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7b4332940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12066:1876035752748672:0@lo:104: 00010000:00010000:0.0:1789127332.077305:0:12066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df7ae728e00/0xeeacf7c024300506 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xeeacf7c0243004ff expref: 16 pid: 5824 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127332.077312:0:12066:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7b4330780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12066:1876035752748800:0@lo:104: 00000100:00100000:0.0:1789127332.088520:0:12066:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7b4331e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12066:1876035752748288:192.168.206.40@tcp:104: 00000100:00100000:0.0:1789127332.088535:0:12066:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7b4331a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12066:1876035752748416:192.168.206.40@tcp:104: 00010000:00010000:0.0:1789127332.088568:0:12066:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8df7ae729c00/0xeeacf7c024300664 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127332.089735:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127332.089852:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127332.090219:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733839232 00000100:00100000:3.0:1789127332.090226:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733839232 00010000:00010000:3.0:1789127332.090260:0:8454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df7bbd96400/0xeeacf7c024300530 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7a78 expref: 13 pid: 5825 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127332.090297:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733839360 00000100:00100000:3.0:1789127332.090300:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733839360 00010000:00010000:3.0:1789127332.090312:0:8454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df798df1c00/0xeeacf7c024300529 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7a71 expref: 14 pid: 5824 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127332.090332:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 38 00000100:00100000:3.0:1789127332.090341:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bfc48f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d829a69b-d740-4e4c-8301-ef09c9d45165+14:2348:x1876035733839232:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789127332.090355:0:8454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127332.090360:0:8454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df7bbd96400/0xeeacf7c024300530 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7a78 expref: 14 pid: 5825 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127332.090371:0:8454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df7bbd96400/0xeeacf7c024300530 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7a78 expref: 14 pid: 5825 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127332.090389:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df7bbd96400/0xeeacf7c024300530 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7a78 expref: 14 pid: 5825 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127332.090402:0:8454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127332.090451:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bfc48f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d829a69b-d740-4e4c-8301-ef09c9d45165+13:2348:x1876035733839232:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 111us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127332.090458:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 38 00000100:00100000:3.0:1789127332.090473:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 39 00000100:00100000:3.0:1789127332.090493:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7889c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d829a69b-d740-4e4c-8301-ef09c9d45165+12:2348:x1876035733839360:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789127332.090501:0:8454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127332.090505:0:8454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df798df1c00/0xeeacf7c024300529 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7a71 expref: 12 pid: 5824 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127332.090514:0:8454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df798df1c00/0xeeacf7c024300529 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7a71 expref: 12 pid: 5824 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127332.090524:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df798df1c00/0xeeacf7c024300529 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7a71 expref: 12 pid: 5824 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127332.090535:0:8454:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8df7ae729c00/0xeeacf7c024300664 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 12066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127332.090543:0:8454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df7ae729c00/0xeeacf7c024300664 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 12066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127332.090556:0:8454:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df7ae729c00/0xeeacf7c024300664 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127332.090563:0:8454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df7ae729c00/0xeeacf7c024300664 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127332.090569:0:8454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8df7ae729c00/0xeeacf7c024300664 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127332.090576:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8df7ae729c00/0xeeacf7c024300664 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127332.090582:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7ae729c00 already unused, calling callback (ffffffffc17a4550) 00010000:00010000:3.0:1789127332.090586:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8df7ae729c00/0xeeacf7c024300664 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127332.090601:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8df7ae729c00/0xeeacf7c024300664 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127332.090614:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8df7ae729c00/0xeeacf7c024300664 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127332.090623:0:8454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127332.090644:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7889c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d829a69b-d740-4e4c-8301-ef09c9d45165+11:2348:x1876035733839360:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 151us (792us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127332.090650:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 39 00010000:00010000:0.0:1789127332.090859:0:12066:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8df7ae729c00/0xeeacf7c024300664 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127332.090875:0:12066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8df7ae729c00/0xeeacf7c024300664 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127332.090894:0:12066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df7ae729c00/0xeeacf7c024300664 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127332.275425:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789127332.383115:0:7646:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00010000:00010000:0.0:1789127333.299044:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127333.363724:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7bfc4a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3301:1876035752749312:0@lo:400:kworker.0 00000100:00100000:0.0:1789127333.363818:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127333.363869:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7bfc48f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1876035752749824:0@lo:400:kworker.0 00000100:00100000:0.0:1789127333.363909:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127333.363946:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789127333.363953:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7bfc4a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1876035752749696:0@lo:400:kworker.0 00000100:00100000:0.0:1789127333.363979:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127333.364008:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7bfc4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876035752749440:0@lo:400:kworker.0 00000100:00100000:0.0:1789127333.364031:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127333.364047:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7bfc4a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752749952:0@lo:400:kworker.0 00000100:00100000:0.0:1789127333.364069:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127333.364087:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789127333.364091:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7bfc4bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1876035752749568:0@lo:400:kworker.0 00000100:00100000:0.0:1789127333.364124:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127333.364153:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752749696 00000100:00100000:0.0:1789127333.364160:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752749696 00000100:00100000:2.0:1789127333.364184:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752749824 00000100:00100000:2.0:1789127333.364188:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752749824 00000100:00100000:0.0:1789127333.364205:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752749952 00000100:00100000:0.0:1789127333.364208:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752749952 00000100:00100000:2.0:1789127333.364210:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752749440 00000100:00100000:2.0:1789127333.364212:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752749440 00000100:00100000:2.0:1789127333.364222:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752749568 00000100:00100000:2.0:1789127333.364224:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752749568 00000100:00100000:0.0:1789127333.364228:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789127333.364235:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789127333.364236:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae05b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1876035752749696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127333.364241:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae05ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876035752749824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127333.364289:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae05ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876035752749824:12345-0@lo:400:kworker.0 Request processed in 47us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127333.364295:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789127333.364313:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789127333.364318:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae05bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876035752749440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127333.364358:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae05bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876035752749440:12345-0@lo:400:kworker.0 Request processed in 40us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127333.364365:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789127333.364374:0:8063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789127333.364376:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789127333.364381:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae05b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876035752749568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127333.364382:0:8063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae058f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1876035752749952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127333.364408:0:8063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae058f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1876035752749952:12345-0@lo:400:kworker.0 Request processed in 28us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127333.364408:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae05b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876035752749568:12345-0@lo:400:kworker.0 Request processed in 27us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127333.364415:0:8063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789127333.364415:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00080000:3.0:1789127333.364429:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789127333.364433:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789127333.364434:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789127333.364445:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7b4314f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1876035752750080:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789127333.364448:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7bfc4bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1876035752749568:0@lo:400:kworker.0 00000100:00100000:2.0:1789127333.364458:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7bfc4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876035752749440:0@lo:400:kworker.0 00000100:00100000:2.0:1789127333.364464:0:3302:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:2.0:1789127333.364469:0:3302:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8df7b43312c0, transno 4294967300 00000100:00100000:3.0:1789127333.364470:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127333.364479:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7bfc4a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752749952:0@lo:400:kworker.0 00000100:00100000:3.0:1789127333.364495:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752750080 00000100:00100000:3.0:1789127333.364499:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752750080 00000100:00100000:3.0:1789127333.364521:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789127333.364527:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b4315e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876035752750080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789127333.364551:0:10333:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789127333.364583:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b4315e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876035752750080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (112us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127333.364608:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789127333.364640:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7b4314f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1876035752750080:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789127333.364708:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752749312 00000100:00100000:1.0:1789127333.364713:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752749312 00000100:00100000:1.0:1789127333.364739:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1789127333.364745:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7906c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+16:3301:x1876035752749312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127333.371915:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae05b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1876035752749696:12345-0@lo:400:kworker.0 Request processed in 7670us (7925us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127333.371939:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:3.0:1789127333.372135:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df7bfc4a580 x1876035752749696/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127349 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127333.372149:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7bfc4a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1876035752749696:0@lo:400:kworker.0 00000100:00100000:1.0:1789127333.372216:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7906c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+16:3301:x1876035752749312:12345-0@lo:400:kworker.0 Request processed in 7469us (8396us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127333.372224:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1789127333.374727:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7bfc4a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3301:1876035752749312:0@lo:400:kworker.0 00000100:00100000:3.0:1789127333.374748:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7bfc48f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1876035752749824:0@lo:400:kworker.0 00000100:00100000:1.0:1789127333.548469:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127333.550623:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733839488 00000100:00100000:2.0:1789127333.550635:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733839488 00000100:00100000:2.0:1789127333.550719:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 282 00000100:00100000:2.0:1789127333.550729:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7906c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d829a69b-d740-4e4c-8301-ef09c9d45165+11:5590:x1876035733839488:12345-192.168.206.40@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789127333.550744:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127333.550762:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df79032d800/0xeeacf7c02430066b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7ac5 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127333.550821:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df79032d800/0xeeacf7c02430066b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7ac5 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127333.550833:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df79032d800/0xeeacf7c02430066b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7ac5 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127333.550866:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df79032d800, rc 0) 00000100:00100000:2.0:1789127333.550942:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7906c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d829a69b-d740-4e4c-8301-ef09c9d45165+12:5590:x1876035733839488:12345-192.168.206.40@tcp:101:ll_cfg_requeue.0 Request processed in 214us (2480us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127333.550949:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 282 00000100:00100000:3.0:1789127333.556425:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127333.556524:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733839616 00000100:00100000:1.0:1789127333.556534:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733839616 00000100:00100000:1.0:1789127333.556592:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 283 00000100:00100000:1.0:1789127333.556603:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7906c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d829a69b-d740-4e4c-8301-ef09c9d45165+12:5590:x1876035733839616:12345-192.168.206.40@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789127333.556931:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7906c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d829a69b-d740-4e4c-8301-ef09c9d45165+12:5590:x1876035733839616:12345-192.168.206.40@tcp:501:ll_cfg_requeue.0 Request processed in 319us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127333.556948:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 283 00000100:00100000:1.0:1789127333.567549:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127333.567644:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733839744 00000100:00100000:3.0:1789127333.567654:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733839744 00000100:00100000:3.0:1789127333.567698:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 284 00000100:00100000:3.0:1789127333.567707:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7906c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d829a69b-d740-4e4c-8301-ef09c9d45165+12:5590:x1876035733839744:12345-192.168.206.40@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789127333.567979:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7906c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d829a69b-d740-4e4c-8301-ef09c9d45165+12:5590:x1876035733839744:12345-192.168.206.40@tcp:503:ll_cfg_requeue.0 Request processed in 272us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127333.567988:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 284 00000100:00100000:3.0:1789127333.572379:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127333.572490:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733839872 00000100:00100000:2.0:1789127333.572500:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733839872 00000100:00100000:2.0:1789127333.572555:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 285 00000100:00100000:2.0:1789127333.572566:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7906cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d829a69b-d740-4e4c-8301-ef09c9d45165+12:10149:x1876035733839872:12345-192.168.206.40@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789127333.572845:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7906cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d829a69b-d740-4e4c-8301-ef09c9d45165+12:10149:x1876035733839872:12345-192.168.206.40@tcp:502:llog_process_th.0 Request processed in 279us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127333.572853:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 285 00000100:00100000:0.0:1789127333.583490:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127333.583585:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733840000 00000100:00100000:1.0:1789127333.583604:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733840000 00000100:00100000:1.0:1789127333.583658:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 286 00000100:00100000:1.0:1789127333.583668:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7906ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d829a69b-d740-4e4c-8301-ef09c9d45165+12:10149:x1876035733840000:12345-192.168.206.40@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789127333.583966:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7906ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d829a69b-d740-4e4c-8301-ef09c9d45165+12:10149:x1876035733840000:12345-192.168.206.40@tcp:502:llog_process_th.0 Request processed in 299us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127333.583974:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 286 00000100:00100000:1.0:1789127333.590461:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127333.594058:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733840128 00000100:00100000:3.0:1789127333.594072:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733840128 00000100:00100000:3.0:1789127333.594197:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 287 00000100:00100000:3.0:1789127333.594208:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7906c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d829a69b-d740-4e4c-8301-ef09c9d45165+12:5590:x1876035733840128:12345-192.168.206.40@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789127333.594225:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127333.594243:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df7c2172a00/0xeeacf7c024300672 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7acc expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127333.594287:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df7c2172a00/0xeeacf7c024300672 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7acc expref: 13 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127333.594297:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df7c2172a00/0xeeacf7c024300672 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7acc expref: 13 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127333.594305:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7c2172a00, rc 0) 00000100:00100000:3.0:1789127333.594367:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7906c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d829a69b-d740-4e4c-8301-ef09c9d45165+13:5590:x1876035733840128:12345-192.168.206.40@tcp:101:ll_cfg_requeue.0 Request processed in 161us (3916us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127333.594375:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 287 00000100:00100000:1.0:1789127333.601124:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127333.601241:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733840256 00000100:00100000:2.0:1789127333.601251:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733840256 00000100:00100000:2.0:1789127333.601306:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 288 00000100:00100000:2.0:1789127333.601316:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7906ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d829a69b-d740-4e4c-8301-ef09c9d45165+13:5590:x1876035733840256:12345-192.168.206.40@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789127333.601723:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7906ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d829a69b-d740-4e4c-8301-ef09c9d45165+13:5590:x1876035733840256:12345-192.168.206.40@tcp:501:ll_cfg_requeue.0 Request processed in 407us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127333.601733:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 288 00000100:00100000:0.0:1789127333.610150:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127333.610272:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733840384 00000100:00100000:3.0:1789127333.610281:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733840384 00000100:00100000:3.0:1789127333.610333:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 289 00000100:00100000:3.0:1789127333.610343:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7906c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d829a69b-d740-4e4c-8301-ef09c9d45165+13:5590:x1876035733840384:12345-192.168.206.40@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789127333.610569:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7906c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d829a69b-d740-4e4c-8301-ef09c9d45165+13:5590:x1876035733840384:12345-192.168.206.40@tcp:503:ll_cfg_requeue.0 Request processed in 226us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127333.610576:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 289 00000100:00100000:3.0:1789127333.625953:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127333.626190:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733840512 00000100:00100000:2.0:1789127333.626199:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733840512 00000100:00100000:2.0:1789127333.626247:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 290 00000100:00100000:2.0:1789127333.626255:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7906cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d829a69b-d740-4e4c-8301-ef09c9d45165+13:10152:x1876035733840512:12345-192.168.206.40@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789127333.626477:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7906cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d829a69b-d740-4e4c-8301-ef09c9d45165+13:10152:x1876035733840512:12345-192.168.206.40@tcp:502:llog_process_th.0 Request processed in 220us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127333.626494:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 290 00000100:00100000:2.0:1789127333.632077:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127333.632176:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733840640 00000100:00100000:1.0:1789127333.632186:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733840640 00000100:00100000:1.0:1789127333.632241:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 291 00000100:00100000:1.0:1789127333.632251:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7906ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d829a69b-d740-4e4c-8301-ef09c9d45165+13:10152:x1876035733840640:12345-192.168.206.40@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789127333.632491:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7906ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d829a69b-d740-4e4c-8301-ef09c9d45165+13:10152:x1876035733840640:12345-192.168.206.40@tcp:502:llog_process_th.0 Request processed in 241us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127333.632499:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 291 10000000:01000000:2.0:1789127333.682983:0:5827:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789127333.682991:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df7b45fe800 from 10 10000000:01000000:2.0:1789127333.682996:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789127333.683046:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df79032de00/0xeeacf7c024300679 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127333.683057:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff8df79032de00/0xeeacf7c024300679 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127333.683067:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff8df79032de00/0xeeacf7c024300679 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127333.683092:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79062a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752750208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789127333.683163:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127333.683239:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7a03346c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789127333.683317:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752750208 00000100:00100000:3.0:1789127333.683325:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752750208 00000100:00100000:3.0:1789127333.683371:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1789127333.683379:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7906cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+16:5827:x1876035752750208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789127333.683393:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127333.683405:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df7c2173200/0xeeacf7c024300680 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xeeacf7c024300679 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127333.683462:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df7c2173200/0xeeacf7c024300680 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xeeacf7c024300679 expref: 17 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127333.683480:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df7c2173200/0xeeacf7c024300680 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c024300679 expref: 17 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127333.683488:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7c2173200, rc 0) 00000100:00100000:3.0:1789127333.683539:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7906cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+17:5827:x1876035752750208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 160us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127333.683546:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1789127333.684264:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79062a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752750208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789127333.684285:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff8df79032de00/0xeeacf7c024300679 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c024300680 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127333.684295:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff8df79032de00/0xeeacf7c024300679 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xeeacf7c024300680 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127333.684358:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79062a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752750336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789127333.684394:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127333.684446:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7a03346c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789127333.684557:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752750336 00000100:00100000:3.0:1789127333.684563:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752750336 00000100:00100000:3.0:1789127333.684614:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1789127333.684622:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7906c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+17:5827:x1876035752750336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789127333.684908:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7906c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+17:5827:x1876035752750336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 285us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127333.684916:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1789127333.686327:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79062a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752750336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789127333.686391:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae05a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752750464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789127333.686475:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127333.686517:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7ae62d180 going to sleep for 11 seconds 00000100:00100000:3.0:1789127333.686534:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752750464 00000100:00100000:3.0:1789127333.686539:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752750464 00000100:00100000:3.0:1789127333.686579:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1789127333.686601:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7906cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+17:5827:x1876035752750464:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789127333.686813:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7906cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+17:5827:x1876035752750464:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 200us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127333.686821:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1789127333.687247:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae05a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752750464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789127333.687816:0:12080:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7b4314f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:12080:1876035752750592:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789127333.687875:0:12080:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127333.687995:0:12080:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7aea319c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789127333.688058:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752750592 00000100:00100000:1.0:1789127333.688064:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752750592 00000100:00100000:1.0:1789127333.688155:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1789127333.688165:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7906c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+17:12080:x1876035752750592:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789127333.688338:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7906c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+17:12080:x1876035752750592:12345-0@lo:502:llog_process_th.0 Request processed in 175us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127333.688345:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:3.0:1789127333.688424:0:12080:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7b4314f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:12080:1876035752750592:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789127333.688460:0:12080:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789127333.688470:0:12080:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127333.688472:0:12080:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789127333.688479:0:12080:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8df7b45fe800 00000020:00000080:3.0:1789127333.688482:0:12080:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789127333.688553:0:12080:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7b4314f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:12080:1876035752750720:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789127333.688586:0:12080:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127333.703761:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752750720 00000100:00100000:2.0:1789127333.703805:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752750720 00000100:00100000:2.0:1789127333.703864:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1789127333.703875:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7906cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+17:12080:x1876035752750720:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789127333.704297:0:12080:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7aea319c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789127333.706030:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7906cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+17:12080:x1876035752750720:12345-0@lo:502:llog_process_th.0 Request processed in 2151us (17437us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127333.706043:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1789127333.706262:0:12080:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7b4314f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:12080:1876035752750720:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789127333.706300:0:12080:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789127333.706307:0:12080:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127333.706310:0:12080:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1789127333.706314:0:12080:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1789127333.707903:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-12 (rc=0) 10000000:01000000:2.0:1789127333.707945:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789127333.707956:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df79032de00/0xeeacf7c024300679 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c024300680 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127333.707968:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff8df79032de00/0xeeacf7c024300679 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c024300680 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127333.707977:0:5827:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789127333.707979:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df788896800 from 10 10000000:01000000:2.0:1789127333.707982:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789127333.708016:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df79032c000/0xeeacf7c024300687 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127333.708023:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff8df79032c000/0xeeacf7c024300687 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127333.708033:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff8df79032c000/0xeeacf7c024300687 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127333.708055:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79062a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752750848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789127333.708108:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127333.708153:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7a0334240 going to sleep for 11 seconds 00000100:00100000:0.0:1789127333.708272:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752750848 00000100:00100000:0.0:1789127333.708279:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752750848 00000100:00100000:0.0:1789127333.708324:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1789127333.708333:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7880ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+17:5827:x1876035752750848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789127333.708345:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127333.708357:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df7ae728200/0xeeacf7c02430068e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xeeacf7c024300687 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127333.708377:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df7ae728200/0xeeacf7c02430068e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xeeacf7c024300687 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127333.708400:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df7ae728200/0xeeacf7c02430068e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c024300687 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127333.708408:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7ae728200, rc 0) 00000100:00100000:0.0:1789127333.708445:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7880ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+18:5827:x1876035752750848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127333.708451:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:2.0:1789127333.708715:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79062a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752750848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789127333.708735:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff8df79032c000/0xeeacf7c024300687 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c02430068e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127333.708744:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff8df79032c000/0xeeacf7c024300687 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xeeacf7c02430068e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127333.708864:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79062a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752750976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789127333.709759:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127333.709826:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7a0334240 going to sleep for 11 seconds 00000100:00100000:2.0:1789127333.709845:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752750976 00000100:00100000:2.0:1789127333.709851:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752750976 00000100:00100000:2.0:1789127333.710080:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1789127333.710092:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7880ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+18:5827:x1876035752750976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789127333.712867:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7880ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+18:5827:x1876035752750976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2768us (3101us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127333.712881:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1789127333.721811:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79062a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752750976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789127333.721875:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae05a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752751104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789127333.721967:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127333.722000:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7ae62d600 going to sleep for 11 seconds 00000100:00100000:3.0:1789127333.722192:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752751104 00000100:00100000:3.0:1789127333.722198:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752751104 00000100:00100000:3.0:1789127333.722250:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1789127333.722260:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7880ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+18:5827:x1876035752751104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789127333.722449:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7880ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+18:5827:x1876035752751104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 191us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127333.722457:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1789127333.722503:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae05a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752751104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789127333.722690:0:12083:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7b4314f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:12083:1876035752751232:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789127333.722728:0:12083:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127333.722741:0:12083:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7aea316c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789127333.722907:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752751232 00000100:00100000:2.0:1789127333.722912:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752751232 00000100:00100000:2.0:1789127333.722955:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1789127333.722962:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7880ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+18:12083:x1876035752751232:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789127333.723102:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7880ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+18:12083:x1876035752751232:12345-0@lo:502:llog_process_th.0 Request processed in 139us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127333.723109:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1789127333.723755:0:12083:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7b4314f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:12083:1876035752751232:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789127333.723784:0:12083:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789127333.723826:0:12083:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127333.723829:0:12083:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789127333.723845:0:12083:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8df788896800 00000020:00000080:3.0:1789127333.723848:0:12083:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789127333.723944:0:12083:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7b4314f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:12083:1876035752751360:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789127333.723987:0:12083:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127333.724014:0:12083:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7aea316c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789127333.724533:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752751360 00000100:00100000:2.0:1789127333.724540:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752751360 00000100:00100000:2.0:1789127333.724687:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1789127333.724701:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7880aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+18:12083:x1876035752751360:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789127333.725000:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7880aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+18:12083:x1876035752751360:12345-0@lo:502:llog_process_th.0 Request processed in 302us (1011us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127333.725008:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1789127333.725753:0:12083:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7b4314f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:12083:1876035752751360:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789127333.725785:0:12083:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789127333.725815:0:12083:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127333.725817:0:12083:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1789127333.725822:0:12083:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1789127333.730086:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-12 (rc=0) 10000000:01000000:1.0:1789127333.730118:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789127333.730128:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df79032c000/0xeeacf7c024300687 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c02430068e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127333.730140:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff8df79032c000/0xeeacf7c024300687 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c02430068e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789127333.730149:0:5827:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789127333.730152:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df788820800 from 10 10000000:01000000:1.0:1789127333.730154:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789127333.730195:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df7bbd97200/0xeeacf7c024300695 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127333.730202:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff8df7bbd97200/0xeeacf7c024300695 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127333.730212:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff8df7bbd97200/0xeeacf7c024300695 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127333.730236:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7bfc48f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752751488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789127333.730298:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127333.730341:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7ae092780 going to sleep for 11 seconds 00000100:00100000:3.0:1789127333.730393:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752751488 00000100:00100000:3.0:1789127333.730400:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752751488 00000100:00100000:3.0:1789127333.730439:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1789127333.730449:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7880ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+18:5827:x1876035752751488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789127333.730461:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127333.730473:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df7c2173400/0xeeacf7c02430069c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xeeacf7c024300695 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127333.730496:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df7c2173400/0xeeacf7c02430069c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xeeacf7c024300695 expref: 19 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127333.730506:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df7c2173400/0xeeacf7c02430069c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c024300695 expref: 19 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127333.730514:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7c2173400, rc 0) 00000100:00100000:3.0:1789127333.730569:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7880ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:5827:x1876035752751488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127333.730577:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1789127333.730708:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7bfc48f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752751488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789127333.730722:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff8df7bbd97200/0xeeacf7c024300695 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c02430069c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127333.730730:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff8df7bbd97200/0xeeacf7c024300695 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xeeacf7c02430069c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127333.730827:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7bfc48f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752751616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789127333.730855:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127333.730874:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7ae092780 going to sleep for 11 seconds 00000100:00100000:3.0:1789127333.731011:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752751616 00000100:00100000:3.0:1789127333.731017:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752751616 00000100:00100000:3.0:1789127333.731046:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1789127333.731052:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7880adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:5827:x1876035752751616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789127333.731279:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7880adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:5827:x1876035752751616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 226us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127333.731286:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1789127333.731309:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7bfc48f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752751616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789127333.731338:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7b4314f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752751744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789127333.731373:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127333.731386:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7aea31540 going to sleep for 11 seconds 00000100:00100000:3.0:1789127333.731404:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752751744 00000100:00100000:3.0:1789127333.731408:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752751744 00000100:00100000:3.0:1789127333.731424:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1789127333.731430:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7880ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:5827:x1876035752751744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789127333.731562:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7880ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:5827:x1876035752751744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 131us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127333.731569:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1789127333.731598:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7b4314f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:5827:1876035752751744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789127333.731764:0:12085:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7b4314f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:12085:1876035752751872:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789127333.731821:0:12085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127333.731840:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752751872 00000100:00100000:3.0:1789127333.731843:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752751872 00000100:00100000:3.0:1789127333.731862:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1789127333.731867:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7880acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:12085:x1876035752751872:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789127333.732027:0:12085:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7aea31b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789127333.732867:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7880acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:12085:x1876035752751872:12345-0@lo:502:llog_process_th.0 Request processed in 993us (1039us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127333.732877:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000040:00080000:0.0:1789127333.738058:0:12084:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789127333.747960:0:12085:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7b4314f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:12085:1876035752751872:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789127333.748009:0:12085:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789127333.748019:0:12085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127333.748021:0:12085:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789127333.748030:0:12085:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8df788820800 00000020:00000080:2.0:1789127333.748033:0:12085:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789127333.748130:0:12085:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79062a940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:12085:1876035752752000:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789127333.748203:0:12085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127333.748246:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752752000 00000100:00100000:2.0:1789127333.748248:0:12085:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7a0334780 going to sleep for 11 seconds 00000100:00100000:3.0:1789127333.748252:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752752000 00000100:00100000:3.0:1789127333.748303:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1789127333.748312:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7880afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:12085:x1876035752752000:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789127333.748528:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7880afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:12085:x1876035752752000:12345-0@lo:502:llog_process_th.0 Request processed in 217us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127333.748536:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1789127333.748689:0:12085:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79062a940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:12085:1876035752752000:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789127333.748711:0:12085:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789127333.748717:0:12085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127333.748719:0:12085:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1789127333.748723:0:12085:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1789127333.749103:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-12 (rc=0) 10000000:01000000:3.0:1789127333.749124:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789127333.749133:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df7bbd97200/0xeeacf7c024300695 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c02430069c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127333.749142:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff8df7bbd97200/0xeeacf7c024300695 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c02430069c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127334.123897:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127334.123967:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127334.124007:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127334.124051:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733840896 00000100:00100000:2.0:1789127334.124061:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733840896 00000100:00100000:2.0:1789127334.124130:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 114 00000100:00100000:2.0:1789127334.124140:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae0592c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+5:2349:x1876035733840896:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:2.0:1789127334.124213:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae0592c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+5:2349:x1876035733840896:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 74us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127334.124221:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 114 00000100:00100000:2.0:1789127334.124337:0:8063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733841024 00000100:00100000:2.0:1789127334.124348:0:8063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733841024 00000100:00100000:2.0:1789127334.124376:0:8063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 55 00000100:00100000:2.0:1789127334.124383:0:8063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae059e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+5:2348:x1876035733841024:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:2.0:1789127334.124423:0:8063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae059e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+5:2348:x1876035733841024:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 41us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127334.124430:0:8063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 55 00000100:00100000:1.0:1789127334.124499:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733840768 00000100:00100000:1.0:1789127334.124504:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733840768 00000100:00100000:1.0:1789127334.124541:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 307 00000100:00100000:1.0:1789127334.124549:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7880ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d829a69b-d740-4e4c-8301-ef09c9d45165+13:2348:x1876035733840768:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:1.0:1789127334.124576:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7880ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d829a69b-d740-4e4c-8301-ef09c9d45165+13:2348:x1876035733840768:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 28us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127334.124582:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 307 00000100:00080000:0.0:1789127334.124668:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789127334.124672:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789127334.126229:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127334.126300:0:10285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733841152 00000100:00100000:2.0:1789127334.126307:0:10285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733841152 00000100:00100000:2.0:1789127334.126373:0:10285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 115 00000100:00100000:2.0:1789127334.126382:0:10285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b4314f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81b0e267-d7e0-4043-b34e-eec2dc4c5a6b+5:2349:x1876035733841152:12345-192.168.206.40@tcp:400:kworker.0 00000100:00080000:1.0:1789127334.126470:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789127334.140505:0:10285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b4314f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81b0e267-d7e0-4043-b34e-eec2dc4c5a6b+5:2349:x1876035733841152:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 14112us (14271us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127334.140520:0:10285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 115 00010000:00010000:0.0:1789127334.325180:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127334.389185:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789127334.389208:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7bfc4a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1876035752752128:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789127334.389282:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127334.389507:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752752128 00000100:00100000:0.0:1789127334.389515:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752752128 00000100:00100000:0.0:1789127334.389582:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789127334.389592:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7af7ccb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876035752752128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789127334.389626:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789127334.389683:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7af7ccb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876035752752128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127334.389690:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:1.0:1789127334.389841:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df7bfc4a940 x1876035752752128/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127350 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127334.389859:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7bfc4a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1876035752752128:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1789127334.771897:0:12084:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789127335.351530:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127336.372846:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127337.395728:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127338.419268:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127338.484881:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae95a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1876035752752640:0@lo:400:kworker.0 00000100:00100000:3.0:1789127338.484958:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127338.485033:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789127338.485039:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7bbd85680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3300:1876035752752256:0@lo:400:kworker.0 00000100:00100000:3.0:1789127338.485084:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127338.485106:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae958780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1876035752752768:0@lo:400:kworker.0 00000100:00100000:3.0:1789127338.485126:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127338.485150:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae959e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876035752752384:0@lo:400:kworker.0 00000100:00100000:3.0:1789127338.485174:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127338.485191:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae958f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752752896:0@lo:400:kworker.0 00000100:00100000:3.0:1789127338.485211:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127338.485227:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789127338.485232:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae959a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1876035752752512:0@lo:400:kworker.0 00000100:00100000:3.0:1789127338.485251:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127338.485277:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752752640 00000100:00100000:3.0:1789127338.485283:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752752640 00000100:00100000:3.0:1789127338.485330:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752752896 00000100:00100000:3.0:1789127338.485332:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752752896 00000100:00100000:3.0:1789127338.485356:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789127338.485364:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae95ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1876035752752640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127338.485413:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae95ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1876035752752640:12345-0@lo:400:kworker.0 Request processed in 50us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127338.485420:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789127338.485436:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789127338.485442:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae919a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1876035752752896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127338.485471:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae919a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1876035752752896:12345-0@lo:400:kworker.0 Request processed in 30us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127338.485476:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789127338.485492:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752752768 00000100:00100000:3.0:1789127338.485495:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752752768 00000100:00100000:3.0:1789127338.485527:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752752384 00000100:00100000:3.0:1789127338.485531:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752752384 00000100:00100000:3.0:1789127338.485541:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752752512 00000100:00100000:3.0:1789127338.485544:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752752512 00000100:00100000:3.0:1789127338.485557:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789127338.485564:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae95a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876035752752768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127338.485599:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae95a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876035752752768:12345-0@lo:400:kworker.0 Request processed in 35us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127338.485605:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789127338.485617:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789127338.485623:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79a387480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876035752752384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127338.485649:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79a387480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876035752752384:12345-0@lo:400:kworker.0 Request processed in 27us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127338.485654:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789127338.485664:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789127338.485669:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae9183c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876035752752512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127338.485694:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae9183c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876035752752512:12345-0@lo:400:kworker.0 Request processed in 25us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127338.485700:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789127338.485744:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae959a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1876035752752512:0@lo:400:kworker.0 00000100:00100000:3.0:1789127338.485754:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae959e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876035752752384:0@lo:400:kworker.0 00000100:00100000:3.0:1789127338.485762:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae958f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752752896:0@lo:400:kworker.0 00000100:00100000:3.0:1789127338.485813:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae958780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1876035752752768:0@lo:400:kworker.0 00010000:00080000:3.0:1789127338.485825:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df7ae95a580 x1876035752752640/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127354 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127338.485847:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae95a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1876035752752640:0@lo:400:kworker.0 00000100:00080000:1.0:1789127338.485989:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789127338.485994:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789127338.485996:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789127338.486002:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789127338.486010:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7bfc4a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752753024:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789127338.486041:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127338.486068:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752753024 00000100:00100000:1.0:1789127338.486072:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752753024 00000100:00100000:1.0:1789127338.486097:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789127338.486104:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bfc4a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876035752753024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789127338.486131:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789127338.486171:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bfc4a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876035752753024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127338.486178:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789127338.486207:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7bfc4a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752753024:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789127338.486350:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752752256 00000100:00100000:2.0:1789127338.486355:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752752256 00000100:00100000:2.0:1789127338.486392:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1789127338.486399:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7880af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:3300:x1876035752752256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127338.486439:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7880af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:3300:x1876035752752256:12345-0@lo:400:kworker.0 Request processed in 40us (1353us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127338.486450:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1789127338.486489:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7bbd85680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3300:1876035752752256:0@lo:400:kworker.0 00000100:00100000:1.0:1789127339.247756:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127339.247826:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127339.247856:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127339.247909:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127339.248028:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733841408 00000100:00100000:0.0:1789127339.248036:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733841408 00000100:00100000:0.0:1789127339.248094:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733841664 00000100:00100000:0.0:1789127339.248097:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733841664 00000100:00100000:0.0:1789127339.248121:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 119 00000100:00100000:0.0:1789127339.248129:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bfc4a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+5:2348:x1876035733841408:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:0.0:1789127339.248206:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bfc4a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+5:2348:x1876035733841408:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 77us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127339.248213:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 119 00000100:00100000:0.0:1789127339.248229:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 120 00000100:00100000:0.0:1789127339.248236:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bfc4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81b0e267-d7e0-4043-b34e-eec2dc4c5a6b+5:2348:x1876035733841664:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:0.0:1789127339.248263:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bfc4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81b0e267-d7e0-4043-b34e-eec2dc4c5a6b+5:2348:x1876035733841664:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 28us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127339.248270:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 120 00000100:00080000:1.0:1789127339.248712:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789127339.249017:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733841536 00000100:00100000:3.0:1789127339.249023:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733841536 00000100:00100000:3.0:1789127339.249080:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 58 00000100:00100000:3.0:1789127339.249089:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bfc4a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+5:2348:x1876035733841536:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:3.0:1789127339.249131:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bfc4a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+5:2348:x1876035733841536:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 43us (1304us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127339.249138:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 58 00000100:00080000:1.0:1789127339.249439:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789127339.250104:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733841280 00000100:00100000:2.0:1789127339.250111:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733841280 00000100:00100000:2.0:1789127339.250225:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 309 00000100:00100000:2.0:1789127339.250234:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7880ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d829a69b-d740-4e4c-8301-ef09c9d45165+13:2348:x1876035733841280:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:2.0:1789127339.253773:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7880ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d829a69b-d740-4e4c-8301-ef09c9d45165+13:2348:x1876035733841280:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 3528us (6013us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127339.253804:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 309 00010000:00010000:0.0:1789127339.443569:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127339.507236:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789127339.507260:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7bfc4bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1876035752753152:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789127339.507331:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127339.507444:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752753152 00000100:00100000:1.0:1789127339.507452:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752753152 00000100:00100000:1.0:1789127339.507507:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789127339.507517:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae059a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876035752753152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789127339.507549:0:10333:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789127339.507614:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae059a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876035752753152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127339.507622:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:1.0:1789127339.507659:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df7bfc4bc00 x1876035752753152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127355 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127339.507676:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7bfc4bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1876035752753152:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789127340.467055:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127341.491070:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127342.518085:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127343.539108:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127343.603024:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae918f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3301:1876035752753280:0@lo:400:kworker.0 00000100:00100000:3.0:1789127343.603038:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae91b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1876035752753536:0@lo:400:kworker.0 00000100:00100000:1.0:1789127343.603053:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae91a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876035752753408:0@lo:400:kworker.0 00000100:00100000:2.0:1789127343.603072:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae91ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1876035752753664:0@lo:400:kworker.0 00000100:00100000:0.0:1789127343.603115:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127343.603116:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127343.603120:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127343.603156:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752753280 00000100:00100000:3.0:1789127343.603164:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752753280 00000100:00100000:1.0:1789127343.603172:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae91b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752753920:0@lo:400:kworker.0 00000100:00100000:0.0:1789127343.603182:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae918b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1876035752753792:0@lo:400:kworker.0 00000100:00100000:1.0:1789127343.603205:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127343.603207:0:8063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752753664 00000100:00100000:2.0:1789127343.603211:0:8063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752753664 00000100:00100000:3.0:1789127343.603214:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1789127343.603217:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127343.603227:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7880af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:3301:x1876035752753280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127343.603235:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789127343.603251:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7bfc4bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752754048:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789127343.603260:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752753920 00000100:00100000:0.0:1789127343.603265:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752753920 00000100:00100000:2.0:1789127343.603266:0:8063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789127343.603277:0:8063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79062a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1876035752753664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127343.603284:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7880af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:3301:x1876035752753280:12345-0@lo:400:kworker.0 Request processed in 58us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127343.603290:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127343.603298:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1789127343.603298:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789127343.603309:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6811c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1876035752753920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127343.603323:0:8063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79062a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1876035752753664:12345-0@lo:400:kworker.0 Request processed in 47us (202us total) trans 0 rc 0/0 00000100:00080000:1.0:1789127343.603327:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789127343.603331:0:8063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:1.0:1789127343.603331:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789127343.603349:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127343.603355:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6811c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1876035752753920:12345-0@lo:400:kworker.0 Request processed in 49us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127343.603363:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789127343.603364:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752753408 00000100:00100000:2.0:1789127343.603370:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752753408 00000100:00100000:1.0:1789127343.603373:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752753792 00000100:00100000:1.0:1789127343.603377:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752753792 00000100:00100000:3.0:1789127343.603387:0:10285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752753536 00000100:00100000:0.0:1789127343.603387:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752754048 00000100:00100000:3.0:1789127343.603392:0:10285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752753536 00000100:00100000:0.0:1789127343.603392:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752754048 00000100:00100000:2.0:1789127343.603402:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1789127343.603408:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789127343.603411:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bfc48f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876035752753408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127343.603415:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae058000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876035752753792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127343.603419:0:10285:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1789127343.603422:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789127343.603426:0:10285:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:0.0:1789127343.603431:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6811c52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876035752754048:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789127343.603444:0:5830:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1789127343.603452:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1789127343.603452:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bfc48f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876035752753408:12345-0@lo:400:kworker.0 Request processed in 41us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127343.603452:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae058000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876035752753792:12345-0@lo:400:kworker.0 Request processed in 37us (235us total) trans 0 rc 0/0 00002000:00000024:0.0:1789127343.603459:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789127343.603461:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae919680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876035752753536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127343.603465:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1789127343.603472:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:1.0:1789127343.603488:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789127343.603508:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df7ae91ad00 x1876035752753664/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127359 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127343.603511:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae919680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876035752753536:12345-0@lo:400:kworker.0 Request processed in 48us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127343.603511:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6811c52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876035752754048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127343.603526:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7bfc4bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752754048:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789127343.603527:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789127343.603531:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1789127343.603536:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae91ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1876035752753664:0@lo:400:kworker.0 00000100:00100000:1.0:1789127343.603542:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae91a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876035752753408:0@lo:400:kworker.0 00000100:00100000:1.0:1789127343.603555:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae91b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752753920:0@lo:400:kworker.0 00000100:00100000:2.0:1789127343.603578:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae918b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1876035752753792:0@lo:400:kworker.0 00000100:00100000:2.0:1789127343.603589:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae918f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3301:1876035752753280:0@lo:400:kworker.0 00000100:00100000:2.0:1789127343.603643:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae91b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1876035752753536:0@lo:400:kworker.0 00000100:00100000:0.0:1789127344.359049:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127344.359087:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127344.359125:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127344.359161:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127344.359226:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733841792 00000100:00100000:3.0:1789127344.359234:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733841792 00000100:00100000:3.0:1789127344.359283:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 311 00000100:00100000:3.0:1789127344.359291:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7880ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d829a69b-d740-4e4c-8301-ef09c9d45165+13:2347:x1876035733841792:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:3.0:1789127344.359357:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7880ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d829a69b-d740-4e4c-8301-ef09c9d45165+13:2347:x1876035733841792:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 66us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127344.359364:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 311 00000100:00100000:3.0:1789127344.359478:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733842048 00000100:00100000:3.0:1789127344.359483:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733842048 00000100:00100000:3.0:1789127344.359516:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 61 00000100:00100000:3.0:1789127344.359523:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae059680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+5:2347:x1876035733842048:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:3.0:1789127344.359555:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae059680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+5:2347:x1876035733842048:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 33us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127344.359562:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 61 00000100:00080000:3.0:1789127344.359577:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789127344.359658:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733841920 00000100:00100000:2.0:1789127344.359662:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733841920 00000100:00100000:2.0:1789127344.359701:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733842176 00000100:00100000:2.0:1789127344.359705:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733842176 00000100:00100000:2.0:1789127344.359727:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 124 00000100:00100000:2.0:1789127344.359734:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae0583c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+5:2347:x1876035733841920:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:2.0:1789127344.359767:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae0583c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+5:2347:x1876035733841920:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 34us (727us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127344.359774:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 124 00000100:00100000:2.0:1789127344.359812:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 125 00000100:00100000:2.0:1789127344.359819:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae05a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81b0e267-d7e0-4043-b34e-eec2dc4c5a6b+5:2347:x1876035733842176:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:2.0:1789127344.359840:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae05a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81b0e267-d7e0-4043-b34e-eec2dc4c5a6b+5:2347:x1876035733842176:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 22us (753us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127344.359847:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 125 00000100:00080000:3.0:1789127344.360225:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789127344.565948:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127344.629068:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae91a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1876035752754176:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789127344.629147:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127344.629463:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752754176 00000100:00100000:3.0:1789127344.629470:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752754176 00000100:00100000:3.0:1789127344.629522:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789127344.629531:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae058780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876035752754176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789127344.629565:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789127344.629620:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae058780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876035752754176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127344.629627:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:1.0:1789127344.629700:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df7ae91a1c0 x1876035752754176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127360 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127344.629717:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae91a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1876035752754176:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1789127345.012784:0:12084:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789127345.590456:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127346.611325:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127347.636341:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127348.659074:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127348.726988:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6811c7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3302:1876035752754432:0@lo:400:kworker.0 00000100:00100000:3.0:1789127348.727074:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127348.727135:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79062d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1876035752754944:0@lo:400:kworker.0 00000100:00100000:3.0:1789127348.727162:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127348.727187:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789127348.727193:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7bfc4bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876035752754560:0@lo:400:kworker.0 00000100:00100000:3.0:1789127348.727216:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127348.727237:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7aeae70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752755072:0@lo:400:kworker.0 00000100:00100000:3.0:1789127348.727276:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127348.727309:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752754944 00000100:00100000:3.0:1789127348.727315:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752754944 00000100:00100000:3.0:1789127348.727366:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752754560 00000100:00100000:3.0:1789127348.727369:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752754560 00000100:00100000:3.0:1789127348.727391:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1789127348.727399:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae91a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876035752754944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127348.727451:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae91a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876035752754944:12345-0@lo:400:kworker.0 Request processed in 52us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127348.727459:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1789127348.727475:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1789127348.727482:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae91b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876035752754560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127348.727509:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae91b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876035752754560:12345-0@lo:400:kworker.0 Request processed in 28us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127348.727516:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1789127348.727535:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752755072 00000100:00100000:3.0:1789127348.727538:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752755072 00000100:00100000:3.0:1789127348.727567:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789127348.727573:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae918f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1876035752755072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127348.727617:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae918f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1876035752755072:12345-0@lo:400:kworker.0 Request processed in 44us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127348.727624:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:3.0:1789127348.727649:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789127348.727654:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789127348.727679:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7bfc4bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876035752754560:0@lo:400:kworker.0 00000100:00100000:3.0:1789127348.727690:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7aeae70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752755072:0@lo:400:kworker.0 00000100:00100000:3.0:1789127348.727700:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79062d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1876035752754944:0@lo:400:kworker.0 00000100:00100000:2.0:1789127348.727938:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6811c6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1876035752754304:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789127348.727972:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127348.728005:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79062c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1876035752754816:0@lo:400:kworker.0 00000100:00100000:2.0:1789127348.728042:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127348.728064:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789127348.728071:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79062f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1876035752754688:0@lo:400:kworker.0 00000100:00100000:2.0:1789127348.728095:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127348.728123:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752754688 00000100:00100000:2.0:1789127348.728127:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752754688 00000100:00100000:2.0:1789127348.728156:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1789127348.728170:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae97a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876035752754688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127348.728210:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae97a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876035752754688:12345-0@lo:400:kworker.0 Request processed in 41us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127348.728216:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1789127348.728248:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79062f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1876035752754688:0@lo:400:kworker.0 00000100:00100000:1.0:1789127348.728380:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752754432 00000100:00100000:1.0:1789127348.728385:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752754432 00000100:00100000:1.0:1789127348.728423:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:1.0:1789127348.728431:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df786b43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:3302:x1876035752754432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127348.728470:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df786b43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:3302:x1876035752754432:12345-0@lo:400:kworker.0 Request processed in 41us (1397us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127348.728476:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1789127348.732038:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752754304 00000100:00100000:3.0:1789127348.732052:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752754304 00000100:00100000:3.0:1789127348.732130:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789127348.732140:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bbd85680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876035752754304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789127348.732177:0:10333:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789127348.732272:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bbd85680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876035752754304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 132us (4297us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127348.732279:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:3.0:1789127348.732301:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789127348.732313:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752754816 00000100:00100000:3.0:1789127348.732317:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752754816 00000100:00100000:3.0:1789127348.732362:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789127348.732369:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae9783c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1876035752754816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127348.732403:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae9783c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1876035752754816:12345-0@lo:400:kworker.0 Request processed in 35us (4361us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127348.732409:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789127348.732453:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6811c7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3302:1876035752754432:0@lo:400:kworker.0 00000100:00100000:2.0:1789127348.732574:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6811c6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1876035752754304:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1789127348.732590:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df79062c780 x1876035752754816/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127364 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127348.732599:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79062c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1876035752754816:0@lo:400:kworker.0 00000100:00080000:1.0:1789127348.734949:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789127349.480472:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127349.480525:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127349.480616:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733842304 00000100:00100000:3.0:1789127349.480626:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733842304 00000100:00100000:3.0:1789127349.480687:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 313 00000100:00100000:3.0:1789127349.480697:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7880af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d829a69b-d740-4e4c-8301-ef09c9d45165+13:2348:x1876035733842304:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:3.0:1789127349.480769:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7880af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d829a69b-d740-4e4c-8301-ef09c9d45165+13:2348:x1876035733842304:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 73us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127349.480777:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 313 00000100:00100000:2.0:1789127349.481820:0:10285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733842432 00000100:00100000:2.0:1789127349.481829:0:10285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733842432 00000100:00100000:2.0:1789127349.481906:0:10285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 129 00000100:00100000:2.0:1789127349.481915:0:10285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae05a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+5:2348:x1876035733842432:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:2.0:1789127349.481975:0:10285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae05a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+5:2348:x1876035733842432:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 62us (1450us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127349.482056:0:10285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 129 00000100:00080000:3.0:1789127349.482517:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789127349.492375:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127349.492500:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127349.494368:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733842688 00000100:00100000:2.0:1789127349.494380:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733842688 00000100:00100000:2.0:1789127349.494466:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 130 00000100:00100000:2.0:1789127349.494474:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae05a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81b0e267-d7e0-4043-b34e-eec2dc4c5a6b+5:2349:x1876035733842688:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:2.0:1789127349.494548:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae05a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81b0e267-d7e0-4043-b34e-eec2dc4c5a6b+5:2349:x1876035733842688:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 75us (2048us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127349.494554:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 130 00000100:00080000:1.0:1789127349.496928:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789127349.498016:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733842560 00000100:00100000:3.0:1789127349.498027:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733842560 00000100:00100000:3.0:1789127349.498157:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 19 00000100:00100000:3.0:1789127349.498167:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae05b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+5:2345:x1876035733842560:12345-192.168.206.40@tcp:9:kworker.0 00000020:00000080:3.0:1789127349.498195:0:6688:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xeeacf7c0243005d8 00000100:00080000:3.0:1789127349.498203:0:6688:0:(import.c:65:import_set_state_nolock()) ffff8df78803f000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789127349.498251:0:6688:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:3.0:1789127349.498512:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae05b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+2:2345:x1876035733842560:12345-192.168.206.40@tcp:9:kworker.0 Request processed in 344us (6144us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127349.498519:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 19 00010000:00010000:2.0:1789127349.500215:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789127349.500552:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789127349.685899:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127349.747820:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789127349.757579:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae918b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1876035752755200:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789127349.757726:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127349.757958:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752755200 00000100:00100000:0.0:1789127349.757967:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752755200 00000100:00100000:0.0:1789127349.765885:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789127349.765908:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae979680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876035752755200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789127349.765953:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789127349.766025:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae979680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876035752755200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (8299us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127349.766032:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:2.0:1789127349.766948:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df7ae918b40 x1876035752755200/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127365 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127349.766969:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae918b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1876035752755200:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789127350.708483:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127351.731075:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127352.755988:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789127352.853020:0:7646:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 28762f98-a240-4662-a754-e28bbeb6cb4b 00000020:00000080:3.0:1789127352.853028:0:7646:0:(genops.c:885:class_export_put()) final put ffff8df78803b800/28762f98-a240-4662-a754-e28bbeb6cb4b 00000020:00000080:3.0:1789127352.853053:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8df78803b800/28762f98-a240-4662-a754-e28bbeb6cb4b for lustre-OST0001 00000020:00000080:3.0:1789127352.853092:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df78803f000 for lustre-OST0001 00010000:00010000:0.0:1789127353.787239:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127353.843039:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a2c4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876035752755456:0@lo:400:kworker.0 00000100:00100000:0.0:1789127353.843106:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127353.843156:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7b4331a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752755968:0@lo:400:kworker.0 00000100:00100000:0.0:1789127353.843181:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127353.843212:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789127353.843218:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7b43312c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1876035752755584:0@lo:400:kworker.0 00000100:00100000:0.0:1789127353.843240:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127353.843267:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752755456 00000100:00100000:0.0:1789127353.843279:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752755456 00000100:00100000:0.0:1789127353.843319:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752755584 00000100:00100000:0.0:1789127353.843322:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752755584 00000100:00100000:0.0:1789127353.843348:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1789127353.843356:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b4331e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876035752755456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127353.843404:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b4331e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876035752755456:12345-0@lo:400:kworker.0 Request processed in 48us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127353.843411:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1789127353.843427:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789127353.843433:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b4332940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876035752755584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127353.843459:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b4332940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876035752755584:12345-0@lo:400:kworker.0 Request processed in 27us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127353.843465:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789127353.843482:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752755968 00000100:00100000:0.0:1789127353.843486:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752755968 00000100:00100000:0.0:1789127353.843509:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789127353.843515:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b4330780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1876035752755968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127353.843544:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b4330780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1876035752755968:12345-0@lo:400:kworker.0 Request processed in 29us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127353.843550:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789127353.843584:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7b43312c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1876035752755584:0@lo:400:kworker.0 00000100:00100000:0.0:1789127353.843594:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a2c4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876035752755456:0@lo:400:kworker.0 00000100:00100000:0.0:1789127353.843601:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7b4331a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752755968:0@lo:400:kworker.0 00000100:00100000:1.0:1789127353.843669:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7b43321c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1876035752755712:0@lo:400:kworker.0 00000100:00100000:1.0:1789127353.843699:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127353.843728:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789127353.843734:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae058b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3300:1876035752755328:0@lo:400:kworker.0 00000100:00100000:1.0:1789127353.843759:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127353.843782:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7b43330c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1876035752755840:0@lo:400:kworker.0 00000100:00100000:1.0:1789127353.843836:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789127353.843860:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789127353.843865:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789127353.843873:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752755328 00000100:00100000:1.0:1789127353.843877:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752755328 00000100:00100000:1.0:1789127353.843904:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1789127353.843910:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df786b40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:3300:x1876035752755328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127353.843944:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df786b40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:3300:x1876035752755328:12345-0@lo:400:kworker.0 Request processed in 34us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127353.843950:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1789127353.843973:0:12098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752755840 00000100:00100000:1.0:1789127353.843977:0:12098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752755840 00000100:00100000:1.0:1789127353.844001:0:12098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1789127353.844007:0:12098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeae7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876035752755840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127353.844034:0:12098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeae7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876035752755840:12345-0@lo:400:kworker.0 Request processed in 27us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127353.844040:0:12098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00080000:1.0:1789127353.844055:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789127353.844068:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae058b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3300:1876035752755328:0@lo:400:kworker.0 00000100:00100000:1.0:1789127353.844086:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7b43330c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1876035752755840:0@lo:400:kworker.0 00000100:00100000:0.0:1789127353.844170:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752755712 00000100:00100000:0.0:1789127353.844174:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752755712 00000100:00100000:0.0:1789127353.844202:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789127353.844217:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeae6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1876035752755712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127353.844250:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeae6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1876035752755712:12345-0@lo:400:kworker.0 Request processed in 34us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127353.844256:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:1.0:1789127353.844307:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789127353.844326:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df7b43321c0 x1876035752755712/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127369 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127353.844337:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7b43321c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1876035752755712:0@lo:400:kworker.0 00000100:00100000:0.0:1789127353.844581:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789127353.844591:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7aeae6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752756096:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789127353.844621:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127353.844686:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752756096 00000100:00100000:1.0:1789127353.844691:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752756096 00000100:00100000:1.0:1789127353.844722:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789127353.844729:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b4331a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876035752756096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789127353.844754:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789127353.844825:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b4331a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876035752756096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127353.844831:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789127353.844861:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7aeae6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752756096:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789127354.609077:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127354.609115:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127354.609146:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127354.609173:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733842816 00000100:00100000:0.0:1789127354.609182:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733842816 00000100:00100000:0.0:1789127354.609225:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 315 00000100:00100000:0.0:1789127354.609235:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df786b43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d829a69b-d740-4e4c-8301-ef09c9d45165+13:2347:x1876035733842816:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:0.0:1789127354.609301:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df786b43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d829a69b-d740-4e4c-8301-ef09c9d45165+13:2347:x1876035733842816:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 66us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127354.609308:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 315 00000100:00100000:0.0:1789127354.609341:0:12098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733842944 00000100:00100000:0.0:1789127354.609345:0:12098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733842944 00000100:00100000:0.0:1789127354.609378:0:12098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733843072 00000100:00100000:0.0:1789127354.609381:0:12098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733843072 00000100:00100000:0.0:1789127354.609402:0:12098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 134 00000100:00100000:0.0:1789127354.609408:0:12098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b43312c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+5:2347:x1876035733842944:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:0.0:1789127354.609437:0:12098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b43312c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+5:2347:x1876035733842944:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 29us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127354.609443:0:12098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 134 00000100:00100000:0.0:1789127354.609468:0:12098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 135 00000100:00100000:0.0:1789127354.609473:0:12098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b4330000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81b0e267-d7e0-4043-b34e-eec2dc4c5a6b+5:2347:x1876035733843072:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:0.0:1789127354.609496:0:12098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b4330000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81b0e267-d7e0-4043-b34e-eec2dc4c5a6b+5:2347:x1876035733843072:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 23us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127354.609501:0:12098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 135 00000100:00080000:0.0:1789127354.609622:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789127354.803027:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127354.867109:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789127354.867142:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae91ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1876035752756224:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789127354.867208:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127354.867255:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752756224 00000100:00100000:3.0:1789127354.867263:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752756224 00000100:00100000:3.0:1789127354.867314:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789127354.867322:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b4333840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876035752756224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789127354.867367:0:10333:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789127354.867458:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b4333840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876035752756224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 136us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127354.867467:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:2.0:1789127354.870431:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df7ae91ad00 x1876035752756224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127370 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127354.870457:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae91ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1876035752756224:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1789127355.251459:0:12084:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789127355.829425:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789127355.939519:0:12247:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 07:49:13 (1789127353) 00010000:00010000:0.0:1789127356.851010:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127357.730770:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127357.735781:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733843200 00000100:00100000:2.0:1789127357.735817:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733843200 00000100:00100000:2.0:1789127357.736186:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 32 00000100:00100000:2.0:1789127357.736200:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae91a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+5:10421:x1876035733843200:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789127357.736221:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127357.736245:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c800/0xeeacf7c0243006a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7ad3 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127357.736384:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032da00/0xeeacf7c0243006aa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127357.736398:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032da00/0xeeacf7c0243006aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127357.736410:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032da00/0xeeacf7c0243006aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789127357.736659:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1789127357.736664:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000100:00080000:0.0:1789127357.736675:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00010000:2.0:1789127357.736755:0:5832:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032da00/0xeeacf7c0243006aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127357.736780:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c800/0xeeacf7c0243006a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7ad3 expref: 7 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127357.736828:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032da00/0xeeacf7c0243006aa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7ad3 expref: 6 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127357.736837:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df7906f6b00) 00010000:00010000:2.0:1789127357.736841:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789127357.736844:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df79032da00, rc 0) 00000100:00100000:2.0:1789127357.737167:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae91a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+6:10421:x1876035733843200:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 Request processed in 970us (6416us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127357.737175:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 32 00000100:00100000:0.0:1789127357.746394:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127357.746494:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733843328 00000100:00100000:1.0:1789127357.746503:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733843328 00000100:00100000:1.0:1789127357.746560:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 33 00000100:00100000:1.0:1789127357.746569:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b4330b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+6:10422:x1876035733843328:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789127357.746587:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127357.746606:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c0243006b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7ada expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127357.746663:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c0243006b8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127357.746676:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c0243006b8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127357.746699:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c0243006b8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127357.746712:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c0243006bf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127357.746719:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c0243006bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127357.746725:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c0243006bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127357.747164:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97400/0xeeacf7c0243006c6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127357.747174:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97400/0xeeacf7c0243006c6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127357.747181:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97400/0xeeacf7c0243006c6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789127357.747266:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1789127357.747270:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1789127357.747347:0:5831:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97400/0xeeacf7c0243006c6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127357.747359:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c0243006b8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127357.747365:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c0243006b8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127357.747381:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c0243006b8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127357.747387:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd97800 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:1.0:1789127357.747391:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c0243006b8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127357.747398:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c0243006b8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127357.747411:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df7906f6b00) 00010000:00010000:1.0:1789127357.747414:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789127357.747418:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c0243006b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127357.747424:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c0243006b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127357.747435:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c0243006bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127357.747442:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c0243006bf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127357.747448:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c0243006bf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127357.747453:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd96600 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:1.0:1789127357.747456:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c0243006bf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127357.747472:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c0243006bf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127357.747481:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8df782d66700) 00010000:00010000:1.0:1789127357.747483:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789127357.747486:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c0243006bf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127357.747491:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c0243006bf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127357.747523:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c0243006b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7ada expref: 8 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127357.747536:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97400/0xeeacf7c0243006c6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7ada expref: 7 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127357.747544:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8df782d66a00) 00010000:00010000:1.0:1789127357.747545:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789127357.747548:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7bbd97400, rc 0) 00000100:00100000:1.0:1789127357.747737:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b4330b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+7:10422:x1876035733843328:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 Request processed in 1167us (1350us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127357.747746:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 33 00000100:00100000:0.0:1789127357.754360:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127357.754505:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733843584 00000100:00100000:3.0:1789127357.754514:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733843584 00000100:00100000:3.0:1789127357.754619:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 34 00000100:00100000:3.0:1789127357.754629:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b4332d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+7:10422:x1876035733843584:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789127357.754647:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127357.754664:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2172c00/0xeeacf7c0243006cd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7ae1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127357.754727:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173000/0xeeacf7c0243006d4 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127357.754741:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173000/0xeeacf7c0243006d4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127357.754751:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173000/0xeeacf7c0243006d4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127357.754863:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173600/0xeeacf7c0243006db lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127357.754872:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173600/0xeeacf7c0243006db lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127357.754879:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173600/0xeeacf7c0243006db lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127357.755528:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2172600/0xeeacf7c0243006e2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127357.755539:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2172600/0xeeacf7c0243006e2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127357.755547:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2172600/0xeeacf7c0243006e2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789127357.755556:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1789127357.755753:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173000/0xeeacf7c0243006d4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127357.755761:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173000/0xeeacf7c0243006d4 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127357.755768:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173000/0xeeacf7c0243006d4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127357.755774:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7c2173000 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:3.0:1789127357.755778:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173000/0xeeacf7c0243006d4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127357.755822:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173000/0xeeacf7c0243006d4 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127357.756614:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8df782d66a00) 00010000:00010000:3.0:1789127357.756619:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127357.756625:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173000/0xeeacf7c0243006d4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127357.756647:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173000/0xeeacf7c0243006d4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127357.756663:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173600/0xeeacf7c0243006db lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127357.756669:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173600/0xeeacf7c0243006db lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127357.756675:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173600/0xeeacf7c0243006db lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127357.756680:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7c2173600 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:3.0:1789127357.756683:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173600/0xeeacf7c0243006db lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127357.756690:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173600/0xeeacf7c0243006db lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127357.756698:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8df79f06cf00) 00010000:00010000:3.0:1789127357.756700:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127357.756704:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173600/0xeeacf7c0243006db lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127357.756709:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173600/0xeeacf7c0243006db lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127357.761879:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2172c00/0xeeacf7c0243006cd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7ae1 expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127357.761908:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2172600/0xeeacf7c0243006e2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7ae1 expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127357.761928:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8df79f06c900) 00010000:00010000:3.0:1789127357.761931:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127357.761935:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7c2172600, rc 0) 00000100:00100000:3.0:1789127357.762507:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b4332d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+9:10422:x1876035733843584:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 Request processed in 7876us (8153us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1789127357.762517:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 34 00000100:00100000:3.0:1789127357.773710:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127357.773826:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733843712 00000100:00100000:2.0:1789127357.773836:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733843712 00000100:00100000:2.0:1789127357.773908:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 35 00000100:00100000:2.0:1789127357.773918:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae918b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+9:10422:x1876035733843712:12345-192.168.206.40@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1789127357.774022:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae918b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+9:10422:x1876035733843712:12345-192.168.206.40@tcp:59:lhsmtool_posix.0 Request processed in 105us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127357.774030:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 35 00010000:00010000:3.0:1789127357.877416:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789127358.324415:0:12084:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789127358.899089:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127358.963169:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6811c6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876035752756480:0@lo:400:kworker.0 00000100:00100000:3.0:1789127358.963239:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127358.963287:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79062d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752756992:0@lo:400:kworker.0 00000100:00100000:3.0:1789127358.963313:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127358.963343:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789127358.963350:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6811c7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1876035752756608:0@lo:400:kworker.0 00000100:00100000:3.0:1789127358.963370:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127358.963402:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752756480 00000100:00100000:3.0:1789127358.963409:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752756480 00000100:00100000:3.0:1789127358.963461:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752756608 00000100:00100000:3.0:1789127358.963465:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752756608 00000100:00100000:3.0:1789127358.963494:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789127358.963502:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bfc4bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876035752756480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127358.963552:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bfc4bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876035752756480:12345-0@lo:400:kworker.0 Request processed in 50us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127358.963560:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789127358.963577:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1789127358.963597:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae958780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876035752756608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127358.963628:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae958780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876035752756608:12345-0@lo:400:kworker.0 Request processed in 32us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127358.963633:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1789127358.963652:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752756992 00000100:00100000:3.0:1789127358.963656:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752756992 00000100:00100000:3.0:1789127358.963684:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789127358.963691:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae95a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1876035752756992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127358.963721:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae95a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1876035752756992:12345-0@lo:400:kworker.0 Request processed in 31us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127358.963728:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:3.0:1789127358.963749:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789127358.963753:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789127358.963818:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6811c7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1876035752756608:0@lo:400:kworker.0 00000100:00100000:3.0:1789127358.963831:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6811c6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876035752756480:0@lo:400:kworker.0 00000100:00100000:3.0:1789127358.963840:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79062d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752756992:0@lo:400:kworker.0 00000100:00100000:2.0:1789127358.963918:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae91ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3301:1876035752756352:0@lo:400:kworker.0 00000100:00100000:2.0:1789127358.963958:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127358.963990:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79062f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1876035752756864:0@lo:400:kworker.0 00000100:00100000:2.0:1789127358.964012:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127358.964032:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789127358.964037:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79062c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1876035752756736:0@lo:400:kworker.0 00000100:00100000:2.0:1789127358.964059:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127358.964084:0:10285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752756864 00000100:00100000:2.0:1789127358.964087:0:10285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752756864 00000100:00100000:2.0:1789127358.964118:0:10285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1789127358.964124:0:10285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae978b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876035752756864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127358.964160:0:10285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae978b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876035752756864:12345-0@lo:400:kworker.0 Request processed in 36us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127358.964166:0:10285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1789127358.964184:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752756736 00000100:00100000:2.0:1789127358.964188:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752756736 00000100:00100000:2.0:1789127358.964211:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789127358.964217:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae97ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1876035752756736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127358.964245:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae97ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1876035752756736:12345-0@lo:400:kworker.0 Request processed in 28us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127358.964250:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:2.0:1789127358.964276:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df79062c780 x1876035752756736/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127358.964286:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79062c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1876035752756736:0@lo:400:kworker.0 00000100:00100000:2.0:1789127358.964294:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79062f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1876035752756864:0@lo:400:kworker.0 00000100:00100000:3.0:1789127358.964480:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752756352 00000100:00100000:3.0:1789127358.964484:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752756352 00000100:00100000:3.0:1789127358.964523:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1789127358.964530:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7902d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:3301:x1876035752756352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127358.964570:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7902d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:3301:x1876035752756352:12345-0@lo:400:kworker.0 Request processed in 40us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127358.964576:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1789127358.964609:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae91ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3301:1876035752756352:0@lo:400:kworker.0 00000100:00080000:3.0:1789127358.964626:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789127358.964636:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789127358.966505:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae958f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1876035752757120:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789127358.966578:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127358.966720:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752757120 00000100:00100000:3.0:1789127358.966728:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752757120 00000100:00100000:3.0:1789127358.966774:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789127358.966815:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae97b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876035752757120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789127358.966847:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789127358.966898:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae97b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876035752757120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127358.966905:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789127358.966996:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae958f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1876035752757120:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789127359.643756:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127359.643859:0:12098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733843840 00000100:00100000:3.0:1789127359.643870:0:12098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733843840 00000100:00100000:3.0:1789127359.643947:0:12098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 36 00000100:00100000:3.0:1789127359.643959:0:12098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b43330c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+9:10464:x1876035733843840:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:3.0:1789127359.643981:0:12098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127359.644001:0:12098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173600/0xeeacf7c0243006f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7ae8 expref: -99 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127359.644062:0:12098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2172c00/0xeeacf7c0243006f7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127359.644076:0:12098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2172c00/0xeeacf7c0243006f7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127359.644088:0:12098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2172c00/0xeeacf7c0243006f7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127359.644101:0:12098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173000/0xeeacf7c0243006fe lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127359.644107:0:12098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173000/0xeeacf7c0243006fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127359.644126:0:12098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173000/0xeeacf7c0243006fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127359.644372:0:12098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2172c00/0xeeacf7c0243006f7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127359.644380:0:12098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2172c00/0xeeacf7c0243006f7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127359.644387:0:12098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2172c00/0xeeacf7c0243006f7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127359.644392:0:12098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7c2172c00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:3.0:1789127359.644397:0:12098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2172c00/0xeeacf7c0243006f7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127359.644404:0:12098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2172c00/0xeeacf7c0243006f7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127359.644417:0:12098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df7906f6b00) 00010000:00010000:3.0:1789127359.644421:0:12098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127359.644426:0:12098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2172c00/0xeeacf7c0243006f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127359.644431:0:12098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2172c00/0xeeacf7c0243006f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127359.644442:0:12098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173000/0xeeacf7c0243006fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127359.644462:0:12098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173000/0xeeacf7c0243006fe lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127359.644475:0:12098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173000/0xeeacf7c0243006fe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127359.644480:0:12098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7c2173000 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:3.0:1789127359.644482:0:12098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173000/0xeeacf7c0243006fe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127359.644489:0:12098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173000/0xeeacf7c0243006fe lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127359.644498:0:12098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8df79f06cf00) 00010000:00010000:3.0:1789127359.644500:0:12098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127359.644503:0:12098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173000/0xeeacf7c0243006fe lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127359.644510:0:12098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173000/0xeeacf7c0243006fe lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127359.644543:0:12098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173600/0xeeacf7c0243006f0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7ae8 expref: 10 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127359.644553:0:12098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df7906f6b00) 00010000:00010000:3.0:1789127359.644556:0:12098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127359.644560:0:12098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173600/0xeeacf7c0243006f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7ae8 expref: 10 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127359.644569:0:12098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7c2173600, rc 0) 00000100:00100000:3.0:1789127359.644627:0:12098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b43330c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+9:10464:x1876035733843840:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 672us (886us total) trans 0 rc 301/301 00000100:00100000:3.0:1789127359.644645:0:12098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 36 00000100:00080000:0.0:1789127359.644914:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789127359.653059:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127359.653142:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733844096 00000100:00100000:2.0:1789127359.653151:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733844096 00000100:00100000:2.0:1789127359.653204:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 37 00000100:00100000:2.0:1789127359.653212:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae959e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+9:10464:x1876035733844096:12345-192.168.206.40@tcp:36:lfs.0 00010000:00010000:2.0:1789127359.653258:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789127359.653281:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032da00/0xeeacf7c0243006aa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7ad3 expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127359.653297:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df7906f6b00) 00010000:00010000:2.0:1789127359.653306:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789127359.653526:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032d200/0xeeacf7c024300705 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127359.653539:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032d200/0xeeacf7c024300705 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127359.653548:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032d200/0xeeacf7c024300705 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127359.653558:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c400/0xeeacf7c02430070c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127359.653565:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c400/0xeeacf7c02430070c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127359.653571:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c400/0xeeacf7c02430070c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789127359.654499:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1789127359.654511:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032d200/0xeeacf7c024300705 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127359.654519:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032d200/0xeeacf7c024300705 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127359.654525:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032d200/0xeeacf7c024300705 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127359.654530:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df79032d200 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:2.0:1789127359.654534:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032d200/0xeeacf7c024300705 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127359.654541:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032d200/0xeeacf7c024300705 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127359.654551:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df7906f6900) 00010000:00010000:2.0:1789127359.654554:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789127359.654558:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032d200/0xeeacf7c024300705 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127359.654563:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032d200/0xeeacf7c024300705 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789127359.654580:0:5832:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000e4e95ea8 reply state 0000000089e94274 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c400/0xeeacf7c02430070c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127359.654589:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789127359.654693:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae959e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+10:10464:x1876035733844096:12345-192.168.206.40@tcp:36:lfs.0 Request processed in 1478us (1639us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1789127359.654710:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 37 00010000:00010000:3.0:1789127359.665297:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c400/0xeeacf7c02430070c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127359.665313:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c400/0xeeacf7c02430070c lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127359.665321:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c400/0xeeacf7c02430070c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127359.665327:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df79032c400 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:3.0:1789127359.665331:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c400/0xeeacf7c02430070c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127359.665338:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c400/0xeeacf7c02430070c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127359.665353:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8df7906f6e00) 00010000:00010000:3.0:1789127359.665357:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127359.665361:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c400/0xeeacf7c02430070c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127359.665367:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c400/0xeeacf7c02430070c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127359.753519:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127359.753570:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127359.753621:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127359.753650:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733844224 00000100:00100000:1.0:1789127359.753659:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733844224 00000100:00100000:1.0:1789127359.753720:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 317 00000100:00100000:1.0:1789127359.753732:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7902da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d829a69b-d740-4e4c-8301-ef09c9d45165+13:2349:x1876035733844224:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:1.0:1789127359.754248:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7902da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d829a69b-d740-4e4c-8301-ef09c9d45165+13:2349:x1876035733844224:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 517us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127359.754257:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 317 00000100:00100000:1.0:1789127359.754295:0:12098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733844352 00000100:00100000:1.0:1789127359.754299:0:12098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733844352 00000100:00100000:1.0:1789127359.754340:0:12098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733844480 00000100:00100000:1.0:1789127359.754343:0:12098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733844480 00000100:00100000:1.0:1789127359.754367:0:12098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 139 00000100:00100000:1.0:1789127359.754375:0:12098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeae4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81b0e267-d7e0-4043-b34e-eec2dc4c5a6b+5:2349:x1876035733844352:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:1.0:1789127359.754410:0:12098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeae4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81b0e267-d7e0-4043-b34e-eec2dc4c5a6b+5:2349:x1876035733844352:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 38us (852us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127359.754417:0:12098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 139 00000100:00100000:1.0:1789127359.754434:0:12098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 38 00000100:00100000:1.0:1789127359.754442:0:12098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeae5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+9:10472:x1876035733844480:12345-192.168.206.40@tcp:101:lctl.0 00010000:00010000:1.0:1789127359.754457:0:12098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127359.754482:0:12098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96800/0xeeacf7c024300713 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7aef expref: -99 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127359.754542:0:12098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96400/0xeeacf7c02430071a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127359.754571:0:12098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96400/0xeeacf7c02430071a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127359.754583:0:12098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96400/0xeeacf7c02430071a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789127359.754706:0:12098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1789127359.754710:0:12098:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1789127359.754762:0:12098:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96400/0xeeacf7c02430071a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127359.754952:0:12098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96800/0xeeacf7c024300713 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7aef expref: 11 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127359.754970:0:12098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96400/0xeeacf7c02430071a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7aef expref: 10 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127359.754979:0:12098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df782d66900) 00010000:00010000:1.0:1789127359.754982:0:12098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789127359.754986:0:12098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7bbd96400, rc 0) 00000100:00100000:1.0:1789127359.755014:0:12098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeae5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+10:10472:x1876035733844480:12345-192.168.206.40@tcp:101:lctl.0 Request processed in 573us (1393us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127359.755021:0:12098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 38 00000100:00080000:1.0:1789127359.755050:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789127359.862595:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127359.863743:0:10285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733844608 00000100:00100000:2.0:1789127359.863755:0:10285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733844608 00000100:00100000:2.0:1789127359.863873:0:10285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 39 00000100:00100000:2.0:1789127359.863882:0:10285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae959a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+10:10479:x1876035733844608:12345-192.168.206.40@tcp:101:bash.0 00010000:00010000:2.0:1789127359.863902:0:10285:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127359.863921:0:10285:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032da00/0xeeacf7c024300721 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7af6 expref: -99 pid: 10285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127359.863974:0:10285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c024300728 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127359.863991:0:10285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c024300728 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127359.864003:0:10285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c024300728 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127359.864016:0:10285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032dc00/0xeeacf7c02430072f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127359.864023:0:10285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032dc00/0xeeacf7c02430072f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127359.864030:0:10285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032dc00/0xeeacf7c02430072f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127359.864138:0:10285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032d200/0xeeacf7c024300736 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127359.864161:0:10285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032d200/0xeeacf7c024300736 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127359.864178:0:10285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032d200/0xeeacf7c024300736 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789127359.864206:0:10285:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:2.0:1789127359.864209:0:10285:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789127359.864244:0:10285:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032d200/0xeeacf7c024300736 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127359.864254:0:10285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c024300728 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127359.864260:0:10285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c024300728 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127359.864266:0:10285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c024300728 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127359.864271:0:10285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df79032c200 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:2.0:1789127359.864275:0:10285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c024300728 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127359.864285:0:10285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c024300728 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127359.864295:0:10285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df782d66900) 00010000:00010000:2.0:1789127359.864297:0:10285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789127359.864301:0:10285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c024300728 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127359.864315:0:10285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c024300728 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127359.864327:0:10285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032dc00/0xeeacf7c02430072f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127359.864332:0:10285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032dc00/0xeeacf7c02430072f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127359.864337:0:10285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032dc00/0xeeacf7c02430072f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127359.864342:0:10285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df79032dc00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:2.0:1789127359.864344:0:10285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032dc00/0xeeacf7c02430072f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127359.864349:0:10285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032dc00/0xeeacf7c02430072f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127359.864355:0:10285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8df7906f6900) 00010000:00010000:2.0:1789127359.864357:0:10285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789127359.864359:0:10285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032dc00/0xeeacf7c02430072f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127359.864364:0:10285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032dc00/0xeeacf7c02430072f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127359.864388:0:10285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032da00/0xeeacf7c024300721 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7af6 expref: 12 pid: 10285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127359.864407:0:10285:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032d200/0xeeacf7c024300736 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7af6 expref: 11 pid: 10285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127359.864415:0:10285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8df7906f6b00) 00010000:00010000:2.0:1789127359.864417:0:10285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789127359.864419:0:10285:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df79032d200, rc 0) 00000100:00100000:2.0:1789127359.864652:0:10285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae959a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+11:10479:x1876035733844608:12345-192.168.206.40@tcp:101:bash.0 Request processed in 769us (2065us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127359.864659:0:10285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 39 00000100:00100000:2.0:1789127359.886127:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127359.886273:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733844864 00000100:00100000:1.0:1789127359.886282:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733844864 00000100:00100000:1.0:1789127359.886338:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 40 00000100:00100000:1.0:1789127359.886347:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae97bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+11:10479:x1876035733844864:12345-192.168.206.40@tcp:101:bash.0 00010000:00010000:1.0:1789127359.886368:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127359.886387:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96800/0xeeacf7c02430073d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7afd expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127359.886506:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c024300744 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127359.886531:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c024300744 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127359.886542:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c024300744 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127359.886581:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c02430074b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127359.886588:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c02430074b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127359.886595:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c02430074b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789127359.887148:0:5830:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:1.0:1789127359.887306:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024300752 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127359.887316:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024300752 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127359.887325:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024300752 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127359.887354:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c024300744 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127359.887361:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c024300744 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127359.887368:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c024300744 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127359.887380:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd97800 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:1.0:1789127359.887384:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c024300744 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127359.887391:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c024300744 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127359.887402:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8df7906f6b00) 00010000:00010000:1.0:1789127359.887405:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789127359.887409:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c024300744 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127359.887415:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c024300744 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789127359.887426:0:5830:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000aba7f23e reply state 00000000adcd4083 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c02430074b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127359.887433:0:5830:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789127359.887460:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96800/0xeeacf7c02430073d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7afd expref: 14 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127359.887472:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024300752 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7afd expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127359.887479:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df782d66f00) 00010000:00010000:1.0:1789127359.887481:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789127359.887483:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7bbd96a00, rc 0) 00000100:00100000:1.0:1789127359.887536:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae97bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+14:10479:x1876035733844864:12345-192.168.206.40@tcp:101:bash.0 Request processed in 1190us (1418us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1789127359.887550:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 40 00010000:00010000:3.0:1789127359.898974:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c02430074b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127359.898989:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c02430074b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127359.899010:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c02430074b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127359.899016:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd96600 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:3.0:1789127359.899021:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c02430074b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127359.899028:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c02430074b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127359.899043:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8df782d66600) 00010000:00010000:3.0:1789127359.899046:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127359.899050:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c02430074b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127359.899056:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c02430074b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127359.901924:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127359.903838:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733844992 00000100:00100000:3.0:1789127359.903851:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733844992 00000100:00100000:3.0:1789127359.903897:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 20 00000100:00100000:3.0:1789127359.903905:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae978f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2345:x1876035733844992:12345-192.168.206.40@tcp:8:bash.0 00010000:00080000:3.0:1789127359.903933:0:6686:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 28762f98-a240-4662-a754-e28bbeb6cb4b@192.168.206.40@tcp t0 exp 0000000000000000 cur 306 last 0 00000020:00000080:3.0:1789127359.903975:0:6686:0:(genops.c:1385:class_connect()) connect: client 28762f98-a240-4662-a754-e28bbeb6cb4b, cookie 0xeeacf7c024300760 00002000:00100000:3.0:1789127359.903988:0:6686:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 28762f98-a240-4662-a754-e28bbeb6cb4b/ffff8df78efd7000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113987 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789127359.904011:0:6686:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789127359.904629:0:6686:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789127359.904670:0:6686:0:(import.c:65:import_set_state_nolock()) ffff8df78efd2800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789127359.904934:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae978f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+6:2345:x1876035733844992:12345-192.168.206.40@tcp:8:bash.0 Request processed in 1027us (3016us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127359.904944:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 20 00000100:00100000:2.0:1789127359.910928:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127359.911082:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733845120 00000100:00100000:0.0:1789127359.911091:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733845120 00000100:00100000:0.0:1789127359.911223:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 21 00000100:00100000:0.0:1789127359.911234:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae97b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+6:0:x1876035733845120:12345-192.168.206.40@tcp:101:bash.0 00010000:00010000:0.0:1789127359.911251:0:6689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127359.911273:0:6689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c40e0629/0xeeacf7c024300767 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7b04 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789127359.911298:0:6689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789127359.911329:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=306s v=(0 0) 00010000:00010000:0.0:1789127359.911333:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789127359.911343:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c40e0629/0xeeacf7c024300767 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b04 expref: 7 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127359.911363:0:6689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c40e0629/0xeeacf7c024300767 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b04 expref: 7 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127359.911889:0:6689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7ae728a00, rc 0) 00000100:00100000:0.0:1789127359.911948:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae97b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+7:0:x1876035733845120:12345-192.168.206.40@tcp:101:bash.0 Request processed in 715us (1029us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127359.911956:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 21 00000100:00100000:0.0:1789127359.914936:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00080000:1.0:1789127359.916935:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789127359.918007:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733845248 00000100:00100000:3.0:1789127359.918021:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733845248 00000100:00100000:3.0:1789127359.918092:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 22 00000100:00100000:3.0:1789127359.918103:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b43321c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+7:10479:x1876035733845248:12345-192.168.206.40@tcp:101:bash.0 00010000:00010000:3.0:1789127359.918119:0:6688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127359.918138:0:6688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b2133a8/0xeeacf7c02430076e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7b0b expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127359.918165:0:6688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c40e0629/0xeeacf7c024300767 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b04 expref: 8 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127359.918175:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127359.918180:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127359.918185:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b2133a8/0xeeacf7c02430076e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b0b expref: 8 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127359.918219:0:6688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c40e0629/0xeeacf7c024300767 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b04 expref: 8 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127359.918233:0:6688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c40e0629/0xeeacf7c024300767 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b04 expref: 8 pid: 6689 timeout: 406 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127359.918247:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae958f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6688:1876035752757248:192.168.206.40@tcp:104: 00000100:00100000:3.0:1789127359.918364:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7ae191b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789127359.924703:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127359.925042:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733845376 00000100:00100000:1.0:1789127359.925052:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733845376 00010000:00010000:1.0:1789127359.925093:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c40e0629/0xeeacf7c024300767 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b04 expref: 9 pid: 6689 timeout: 406 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127359.925131:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 40 00000100:00100000:1.0:1789127359.925141:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae97a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+9:2349:x1876035733845376:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789127359.925156:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789127359.925179:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c40e0629/0xeeacf7c024300767 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b04 expref: 9 pid: 6689 timeout: 406 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127359.925194:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c40e0629/0xeeacf7c024300767 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b04 expref: 9 pid: 6689 timeout: 406 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127359.925220:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789127359.925225:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789127359.925234:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000b2133a8/0xeeacf7c02430076e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b0b expref: 9 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127359.925244:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b2133a8/0xeeacf7c02430076e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b0b expref: 9 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127359.925281:0:5817:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000000b2133a8/0xeeacf7c02430076e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b0b expref: 9 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127359.925309:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7aeae6580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5817:1876035752757376:192.168.206.40@tcp:105: 00000100:00100000:1.0:1789127359.925384:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7bbd93b40 going to sleep for 11 seconds 00010000:00010000:3.0:1789127359.925595:0:6688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c40e0629/0xeeacf7c024300767 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b04 expref: 9 pid: 6689 timeout: 406 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127359.925609:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae958f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6688:1876035752757248:192.168.206.40@tcp:104: 00010000:00010000:3.0:1789127359.925637:0:6688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000b2133a8/0xeeacf7c02430076e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b0b expref: 8 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127359.925646:0:6688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7c2173600, rc 0) 00000100:00100000:3.0:1789127359.925672:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b43321c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+8:10479:x1876035733845248:12345-192.168.206.40@tcp:101:bash.0 Request processed in 7571us (10745us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127359.925679:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 22 00000100:00100000:1.0:1789127359.928711:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7aeae6580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5817:1876035752757376:192.168.206.40@tcp:105: 00010000:00010000:1.0:1789127359.928750:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789127359.928843:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae97a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+7:2349:x1876035733845376:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 3701us (4146us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127359.928854:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 40 00000100:00100000:3.0:1789127359.933945:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127359.934374:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733845632 00000100:00100000:2.0:1789127359.934384:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733845632 00000100:00100000:2.0:1789127359.934447:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 6 00000100:00100000:2.0:1789127359.934456:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae958f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+13:10479:x1876035733845632:12345-192.168.206.40@tcp:35:bash.0 00000001:00080000:2.0:1789127359.934765:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967312 00000100:00100000:2.0:1789127359.934917:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae958f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+15:10479:x1876035733845632:12345-192.168.206.40@tcp:35:bash.0 Request processed in 461us (981us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1789127359.934926:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 6 00000020:00080000:2.0:1789127359.934931:0:5833:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789127359.936638:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127359.987100:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789127359.987121:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae91ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1876035752757504:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789127359.987186:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127359.987490:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752757504 00000100:00100000:3.0:1789127359.987497:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752757504 00000100:00100000:3.0:1789127359.987560:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789127359.987569:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae9792c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876035752757504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789127359.987600:0:10333:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789127359.987648:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae9792c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876035752757504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127359.987655:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789127359.987701:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae91ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1876035752757504:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789127360.047241:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127360.047324:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733845888 00000100:00100000:3.0:1789127360.047333:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733845888 00000100:00100000:1.0:1789127360.047533:0:12098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 41 00000100:00100000:1.0:1789127360.047545:0:12098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae979e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+15:10489:x1876035733845888:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:1.0:1789127360.047567:0:12098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127360.047586:0:12098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96800/0xeeacf7c024300775 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7b12 expref: -99 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789127360.047694:0:12098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1789127360.047831:0:12098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96800/0xeeacf7c024300775 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b12 expref: 17 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127360.047846:0:12098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df782d66900) 00010000:00010000:1.0:1789127360.047850:0:12098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789127360.047856:0:12098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96800/0xeeacf7c024300775 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b12 expref: 17 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127360.047869:0:12098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7bbd96800, rc 0) 00000100:00100000:1.0:1789127360.047930:0:12098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae979e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+16:10489:x1876035733845888:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 387us (697us total) trans 4294967314 rc 301/301 00000100:00100000:1.0:1789127360.047951:0:12098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 41 00000100:00100000:3.0:1789127360.052084:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127360.060216:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733846144 00000100:00100000:2.0:1789127360.060229:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733846144 00000100:00100000:2.0:1789127360.060287:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 7 00000100:00100000:2.0:1789127360.060296:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae91ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+16:10489:x1876035733846144:12345-192.168.206.40@tcp:35:lfs.0 00000100:00100000:2.0:1789127360.060523:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae91ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+17:10489:x1876035733846144:12345-192.168.206.40@tcp:35:lfs.0 Request processed in 226us (8447us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1789127360.060532:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 7 00000001:00100000:3.0:1789127360.073221:0:6714:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 28762f98-a240-4662-a754-e28bbeb6cb4b 00000100:00100000:2.0:1789127360.144281:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127360.144372:0:10285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733846272 00000100:00100000:3.0:1789127360.144381:0:10285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733846272 00000100:00100000:3.0:1789127360.144442:0:10285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 42 00000100:00100000:3.0:1789127360.144461:0:10285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae979a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+17:10495:x1876035733846272:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:3.0:1789127360.144484:0:10285:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127360.144504:0:10285:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173000/0xeeacf7c024300783 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7b19 expref: -99 pid: 10285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127360.144570:0:10285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2172c00/0xeeacf7c02430078a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127360.144584:0:10285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2172c00/0xeeacf7c02430078a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127360.144607:0:10285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2172c00/0xeeacf7c02430078a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789127360.144660:0:10285:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:3.0:1789127360.144664:0:10285:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1789127360.144690:0:10285:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2172c00/0xeeacf7c02430078a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127360.144716:0:10285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173000/0xeeacf7c024300783 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b19 expref: 19 pid: 10285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127360.144734:0:10285:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2172c00/0xeeacf7c02430078a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b19 expref: 18 pid: 10285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127360.144742:0:10285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8df7906f6b00) 00010000:00010000:3.0:1789127360.144745:0:10285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789127360.144770:0:10285:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7c2172c00, rc 0) 00000100:00100000:3.0:1789127360.144916:0:10285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae979a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+18:10495:x1876035733846272:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 457us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127360.144923:0:10285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 42 00000100:00100000:3.0:1789127360.149705:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127360.149983:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733846528 00000100:00100000:2.0:1789127360.149993:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733846528 00000100:00100000:2.0:1789127360.150078:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 43 00000100:00100000:2.0:1789127360.150088:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79062f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+18:10495:x1876035733846528:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:2.0:1789127360.150108:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127360.150131:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032ca00/0xeeacf7c024300791 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7b20 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127360.150315:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c024300798 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127360.150330:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c024300798 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127360.150343:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c024300798 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789127360.150355:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789127360.150704:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032ca00/0xeeacf7c024300791 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b20 expref: 21 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127360.151034:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c024300798 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b20 expref: 20 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127360.151043:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df782d66f00) 00010000:00010000:2.0:1789127360.151046:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789127360.151049:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df79032c200, rc 0) 00000100:00100000:2.0:1789127360.151158:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79062f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+20:10495:x1876035733846528:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 1071us (1575us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1789127360.151167:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 43 00000100:00100000:0.0:1789127360.157091:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127360.157208:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127360.157676:0:12098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733846784 00000100:00100000:1.0:1789127360.157685:0:12098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733846784 00000100:00100000:1.0:1789127360.157847:0:12098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 44 00000100:00100000:1.0:1789127360.157857:0:12098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79a2c4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+20:10495:x1876035733846784:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:1.0:1789127360.157879:0:12098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127360.157899:0:12098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96800/0xeeacf7c0243007a6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7b27 expref: -99 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127360.157998:0:12098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c0243007ad lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127360.158013:0:12098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c0243007ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127360.158025:0:12098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c0243007ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789127360.158037:0:12098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1789127360.158148:0:12098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96800/0xeeacf7c0243007a6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b27 expref: 23 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127360.158167:0:12098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c0243007ad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b27 expref: 22 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127360.158177:0:12098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df782d66f00) 00010000:00010000:1.0:1789127360.158180:0:12098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789127360.158183:0:12098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7bbd97800, rc 0) 00000100:00100000:1.0:1789127360.159991:0:12098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79a2c4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+22:10495:x1876035733846784:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 1360us (2131us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1789127360.160004:0:12098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 44 00000100:00100000:2.0:1789127360.160283:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733846912 00000100:00100000:2.0:1789127360.160291:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733846912 00000100:00100000:2.0:1789127360.160340:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 2 00000100:00100000:2.0:1789127360.160349:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df787b8d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+22:2348:x1876035733846912:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789127360.160361:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789127360.160385:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c024300798 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b20 expref: 22 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127360.160403:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df782d66f00) 00010000:00010000:2.0:1789127360.160407:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789127360.160475:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df787b8d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+21:2348:x1876035733846912:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 127us (3266us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127360.160483:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 2 00000100:00100000:0.0:1789127360.168915:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127360.169146:0:8063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733847040 00000100:00100000:3.0:1789127360.169155:0:8063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733847040 00000100:00100000:3.0:1789127360.169206:0:8063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 23 00000100:00100000:3.0:1789127360.169215:0:8063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df787b8c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+6:2349:x1876035733847040:12345-192.168.206.40@tcp:1:lfs.0 00010000:00010000:3.0:1789127360.169273:0:8063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f22728c8/0xeeacf7c0243007bb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127360.169295:0:8063:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000b2133a8/0xeeacf7c02430076e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b0b expref: 6 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127360.169305:0:8063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127360.169309:0:8063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789127360.169314:0:8063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f22728c8/0xeeacf7c0243007bb lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127360.169347:0:8063:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000b2133a8/0xeeacf7c02430076e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b0b expref: 6 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127360.169361:0:8063:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000b2133a8/0xeeacf7c02430076e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b0b expref: 6 pid: 6688 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127360.169375:0:8063:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79062c780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8063:1876035752757632:192.168.206.40@tcp:104: 00000100:00100000:3.0:1789127360.169565:0:8063:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7854970c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789127360.173442:0:8063:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79062c780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8063:1876035752757632:192.168.206.40@tcp:104: 00010000:00010000:3.0:1789127360.173484:0:8063:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f22728c8/0xeeacf7c0243007bb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127360.173905:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127360.174140:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733847168 00000100:00100000:1.0:1789127360.174148:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733847168 00002000:00100000:1.0:1789127360.174187:0:6692:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff8df787b8e580 x1876035733847168/t0(0) o4->28762f98-a240-4662-a754-e28bbeb6cb4b@192.168.206.40@tcp:96/0 lens 504/0 e 0 to 0 dl 1789127371 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789127360.174197:0:6692:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff8df787b8e580 with x1876035733847168 ext(0->12) 00010000:00010000:1.0:1789127360.174205:0:6692:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000000b2133a8/0xeeacf7c02430076e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b0b expref: 7 pid: 6688 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127360.174230:0:6692:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000000b2133a8/0xeeacf7c02430076e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b0b expref: 7 pid: 6688 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789127360.174239:0:6692:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8df787b8e580 00000100:00100000:1.0:1789127360.174269:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 0 00000100:00100000:1.0:1789127360.174277:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df787b8e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+7:2349:x1876035733847168:12345-192.168.206.40@tcp:4:lfs.0 00000100:00100000:1.0:1789127360.177506:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df787b8e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+9:2349:x1876035733847168:12345-192.168.206.40@tcp:4:lfs.0 Request processed in 3220us (3595us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1789127360.177521:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 0 00002000:00100000:1.0:1789127360.177533:0:6692:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff8df787b8e580 x1876035733847168/t4294967299(0) o4->28762f98-a240-4662-a754-e28bbeb6cb4b@192.168.206.40@tcp:96/0 lens 504/448 e 0 to 0 dl 1789127371 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789127360.177542:0:6692:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff8df787b8e580 with x1876035733847168 ext(0->12) 00010000:00010000:1.0:1789127360.177552:0:6692:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000000b2133a8/0xeeacf7c02430076e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b0b expref: 9 pid: 6688 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127360.177587:0:6692:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000000b2133a8/0xeeacf7c02430076e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b0b expref: 9 pid: 6688 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789127360.177595:0:6692:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8df787b8e580 00000100:00100000:0.0:1789127360.187415:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127360.188953:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733847296 00000100:00100000:3.0:1789127360.188965:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733847296 00010000:00010000:2.0:1789127360.189253:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000b2133a8/0xeeacf7c02430076e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b0b expref: 9 pid: 6688 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127360.189359:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 41 00000100:00100000:2.0:1789127360.189371:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df787b8f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+9:2348:x1876035733847296:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789127360.189386:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789127360.189403:0:5816:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1789127360.189406:0:5816:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1789127359 00002000:00010000:2.0:1789127360.189408:0:5816:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1789127359 00002000:00010000:2.0:1789127360.189410:0:5816:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1789127359 00010000:00010000:2.0:1789127360.189416:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000b2133a8/0xeeacf7c02430076e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b0b expref: 9 pid: 6688 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127360.189429:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000b2133a8/0xeeacf7c02430076e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b0b expref: 9 pid: 6688 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127360.189463:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b2133a8/0xeeacf7c02430076e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b0b expref: 9 pid: 6688 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127360.189482:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789127360.189486:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789127360.189492:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f22728c8/0xeeacf7c0243007bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127360.189502:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f22728c8/0xeeacf7c0243007bb lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127360.189532:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789127360.189594:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df787b8f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+8:2348:x1876035733847296:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 226us (2187us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127360.189602:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 41 00010000:00010000:3.0:1789127360.190278:0:8063:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f22728c8/0xeeacf7c0243007bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127360.190291:0:8063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f22728c8/0xeeacf7c0243007bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127360.190318:0:8063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f22728c8/0xeeacf7c0243007bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127360.190327:0:8063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f22728c8/0xeeacf7c0243007bb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127360.190335:0:8063:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f22728c8/0xeeacf7c0243007bb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127360.190342:0:8063:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7c2173000 already unused, calling callback (ffffffffc17a4550) 00010000:00010000:3.0:1789127360.190346:0:8063:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f22728c8/0xeeacf7c0243007bb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127360.190369:0:8063:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f22728c8/0xeeacf7c0243007bb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127360.190385:0:8063:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f22728c8/0xeeacf7c0243007bb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127360.190393:0:8063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f22728c8/0xeeacf7c0243007bb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127360.190470:0:8063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df787b8c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+7:2349:x1876035733847040:12345-192.168.206.40@tcp:1:lfs.0 Request processed in 21254us (21562us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127360.190479:0:8063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 23 00000100:00100000:0.0:1789127360.192722:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127360.192834:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733847552 00000100:00100000:2.0:1789127360.192842:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733847552 00000100:00100000:2.0:1789127360.192890:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 8 00000100:00100000:2.0:1789127360.192899:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df787b8cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+21:10495:x1876035733847552:12345-192.168.206.40@tcp:35:lfs.0 00000004:00010000:2.0:1789127360.192955:0:5833:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c0243007ad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b27 expref: 21 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789127360.193217:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:2.0:1789127360.193466:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:2.0:1789127360.194064:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00010000:00010000:2.0:1789127360.194119:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c0243007c2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127360.194138:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024300752 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7afd expref: 25 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127360.194147:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c0243007c2 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127360.194180:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024300752 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7afd expref: 25 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127360.194195:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024300752 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7afd expref: 25 pid: 5830 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127360.194208:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae978000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5833:1876035752757760:192.168.206.40@tcp:104: 00000100:00100000:2.0:1789127360.194771:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7b46beb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789127360.197294:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae978000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5833:1876035752757760:192.168.206.40@tcp:104: 00010000:00010000:2.0:1789127360.197474:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c0243007c2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127360.198840:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127360.199026:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733847680 00000100:00100000:2.0:1789127360.199033:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733847680 00010000:00010000:2.0:1789127360.199074:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024300752 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7afd expref: 26 pid: 5830 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127360.199121:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 42 00000100:00100000:2.0:1789127360.199133:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df787b8ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+26:2348:x1876035733847680:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789127360.199149:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789127360.199156:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024300752 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7afd expref: 26 pid: 5830 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127360.199171:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024300752 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7afd expref: 26 pid: 5830 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127360.199197:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024300752 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7afd expref: 26 pid: 5830 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127360.199214:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df782d66f00) 00010000:00010000:2.0:1789127360.199218:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c0243007c2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127360.199236:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c0243007c2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127360.199263:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c0243007c2 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127360.199434:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789127360.199557:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c0243007c2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127360.199568:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c0243007c2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789127360.199725:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000001:00080000:3.0:1789127360.200006:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:3.0:1789127360.200141:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79062c780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5833:1876035752757888:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789127360.200404:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127360.200513:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df785497b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789127360.200762:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df787b8ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+27:2348:x1876035733847680:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 1630us (1924us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127360.200782:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 42 00000100:00100000:1.0:1789127360.205541:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752757888 00000100:00100000:1.0:1789127360.205554:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752757888 00000100:00100000:1.0:1789127360.205683:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789127360.205694:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79062d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5833:x1876035752757888:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789127360.206814:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79062d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5833:x1876035752757888:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 1118us (6409us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127360.206826:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1789127360.208017:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789127360.208128:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79062c780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5833:1876035752757888:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789127360.208961:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:2.0:1789127360.209043:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae978000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5833:1876035752758016:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789127360.209100:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127360.209125:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7b46bed80 going to sleep for 11 seconds 00000100:00100000:1.0:1789127360.209664:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752758016 00000100:00100000:1.0:1789127360.209683:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752758016 00000100:00100000:1.0:1789127360.209810:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789127360.209821:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae97a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5833:x1876035752758016:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789127360.210001:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae97a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5833:x1876035752758016:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 182us (900us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1789127360.210009:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789127360.210091:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae978000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5833:1876035752758016:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789127360.210148:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:2.0:1789127360.210183:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c0243007c2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127360.210192:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c0243007c2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127360.210200:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c0243007c2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127360.210207:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df79032c200 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:2.0:1789127360.210211:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c0243007c2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127360.210231:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c0243007c2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127360.210262:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df782d66f00) 00010000:00010000:2.0:1789127360.210265:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789127360.210271:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c0243007c2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127360.210278:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c0243007c2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789127360.210742:0:5833:0:(mdd_object.c:4024:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789127360.210985:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1789127360.210995:0:5833:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 306367206307ns, next at 307367204277ns, rc = 0 00000001:00080000:2.0:1789127360.211003:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:2.0:1789127360.211036:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df782d66f00) 00010000:00010000:2.0:1789127360.211040:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789127360.211047:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c0243007ad lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b27 expref: 29 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127360.211143:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df787b8cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+28:10495:x1876035733847552:12345-192.168.206.40@tcp:35:lfs.0 Request processed in 18245us (18427us total) trans 4294967326 rc 0/0 00000100:00100000:2.0:1789127360.211152:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 8 00000020:00080000:2.0:1789127360.211156:0:5833:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1789127360.227881:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127360.228033:0:10285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733847808 00000100:00100000:3.0:1789127360.228041:0:10285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733847808 00000100:00100000:3.0:1789127360.228112:0:10285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 45 00000100:00100000:3.0:1789127360.228122:0:10285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df787b8f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+28:10495:x1876035733847808:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:3.0:1789127360.228146:0:10285:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127360.228170:0:10285:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173000/0xeeacf7c0243007c9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7b2e expref: -99 pid: 10285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127360.228239:0:10285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173000/0xeeacf7c0243007c9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b2e expref: 29 pid: 10285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127360.228259:0:10285:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173000/0xeeacf7c0243007c9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b2e expref: 29 pid: 10285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127360.228278:0:10285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df79f06cb00) 00010000:00010000:3.0:1789127360.228281:0:10285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789127360.228285:0:10285:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7c2173000, rc 0) 00000100:00100000:3.0:1789127360.228576:0:10285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df787b8f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+29:10495:x1876035733847808:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 454us (703us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127360.228583:0:10285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 45 00000100:00100000:3.0:1789127360.230944:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127360.232194:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733848064 00000100:00100000:2.0:1789127360.232208:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733848064 00000100:00100000:2.0:1789127360.232276:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 9 00000100:00100000:2.0:1789127360.232287:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79156b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+29:10495:x1876035733848064:12345-192.168.206.40@tcp:35:lfs.0 00000100:00100000:2.0:1789127360.232652:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79156b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+30:10495:x1876035733848064:12345-192.168.206.40@tcp:35:lfs.0 Request processed in 364us (1713us total) trans 4294967327 rc 0/0 00000100:00100000:2.0:1789127360.232676:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 9 00000100:00100000:2.0:1789127360.307686:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127360.307832:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733848320 00000100:00100000:0.0:1789127360.307840:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733848320 00000100:00100000:0.0:1789127360.307900:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 46 00000100:00100000:0.0:1789127360.307910:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae97b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+30:10505:x1876035733848320:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:0.0:1789127360.307948:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127360.307968:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728a00/0xeeacf7c0243007d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7b35 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789127360.308075:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1789127360.308191:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728a00/0xeeacf7c0243007d0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b35 expref: 32 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127360.308205:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df782d66900) 00010000:00010000:0.0:1789127360.308207:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789127360.308213:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728a00/0xeeacf7c0243007d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b35 expref: 32 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127360.308225:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7ae728a00, rc 0) 00000100:00100000:0.0:1789127360.308275:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae97b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+31:10505:x1876035733848320:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 366us (609us total) trans 4294967328 rc 301/301 00000100:00100000:0.0:1789127360.308283:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 46 00000100:00100000:3.0:1789127360.322374:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127360.323852:0:12098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733848448 00000100:00100000:1.0:1789127360.323865:0:12098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733848448 00000100:00100000:1.0:1789127360.323935:0:12098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 47 00000100:00100000:1.0:1789127360.323944:0:12098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79062c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+31:10505:x1876035733848448:12345-192.168.206.40@tcp:34:lfs.0 00010000:00010000:1.0:1789127360.324021:0:12098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c0243007de lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127360.324055:0:12098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c0243007de lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127360.324067:0:12098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c0243007de lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127360.324083:0:12098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96800/0xeeacf7c0243007e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127360.324091:0:12098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96800/0xeeacf7c0243007e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127360.324098:0:12098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96800/0xeeacf7c0243007e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127360.324197:0:12098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c0243007ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127360.324206:0:12098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c0243007ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127360.324213:0:12098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c0243007ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789127360.324266:0:12098:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c0243007ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127360.324277:0:12098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c0243007de lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127360.324283:0:12098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c0243007de lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127360.324299:0:12098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c0243007de lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127360.324561:0:12098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd96a00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:1.0:1789127360.324565:0:12098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c0243007de lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127360.324573:0:12098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c0243007de lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127360.324585:0:12098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8df7906f6b00) 00010000:00010000:1.0:1789127360.324588:0:12098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789127360.324592:0:12098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c0243007de lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127360.324598:0:12098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c0243007de lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127360.324610:0:12098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96800/0xeeacf7c0243007e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127360.324616:0:12098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96800/0xeeacf7c0243007e5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127360.324622:0:12098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96800/0xeeacf7c0243007e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127360.324626:0:12098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd96800 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:1.0:1789127360.324629:0:12098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96800/0xeeacf7c0243007e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127360.324644:0:12098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96800/0xeeacf7c0243007e5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127360.324652:0:12098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8df782d66b00) 00010000:00010000:1.0:1789127360.324654:0:12098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789127360.324657:0:12098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96800/0xeeacf7c0243007e5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127360.324663:0:12098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96800/0xeeacf7c0243007e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127360.324677:0:12098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c0243007ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127360.324683:0:12098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c0243007ec lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127360.324689:0:12098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c0243007ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127360.324694:0:12098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd96600 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:1.0:1789127360.324697:0:12098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c0243007ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127360.324702:0:12098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c0243007ec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127360.324708:0:12098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df79f06cb00) 00010000:00010000:1.0:1789127360.324711:0:12098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789127360.324713:0:12098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c0243007ec lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127360.324729:0:12098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c0243007ec lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127360.324892:0:12098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79062c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+31:10505:x1876035733848448:12345-192.168.206.40@tcp:34:lfs.0 Request processed in 947us (2525us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127360.324901:0:12098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 47 00000100:00100000:1.0:1789127360.329012:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127360.329139:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733848704 00000100:00100000:3.0:1789127360.329149:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733848704 00000100:00100000:3.0:1789127360.329192:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 10 00000100:00100000:3.0:1789127360.329202:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeae6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+31:10505:x1876035733848704:12345-192.168.206.40@tcp:35:lfs.0 00000100:00100000:3.0:1789127360.329473:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeae6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+32:10505:x1876035733848704:12345-192.168.206.40@tcp:35:lfs.0 Request processed in 271us (469us total) trans 4294967329 rc 0/0 00000100:00100000:3.0:1789127360.329480:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 10 00000100:00100000:0.0:1789127360.400904:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127360.400972:0:10285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733848960 00000100:00100000:3.0:1789127360.400981:0:10285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733848960 00000100:00100000:3.0:1789127360.401041:0:10285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 48 00000100:00100000:3.0:1789127360.401051:0:10285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df787b8fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+32:10508:x1876035733848960:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:3.0:1789127360.401075:0:10285:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127360.401094:0:10285:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173e00/0xeeacf7c0243007f3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7b3c expref: -99 pid: 10285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127360.401179:0:10285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173600/0xeeacf7c0243007fa lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127360.401195:0:10285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173600/0xeeacf7c0243007fa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127360.401206:0:10285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173600/0xeeacf7c0243007fa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127360.401221:0:10285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024300801 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127360.401228:0:10285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024300801 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127360.401234:0:10285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024300801 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127360.401352:0:10285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c024300808 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127360.401361:0:10285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c024300808 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127360.401383:0:10285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c024300808 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789127360.401393:0:10285:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1789127360.401696:0:10285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173600/0xeeacf7c0243007fa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127360.401704:0:10285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173600/0xeeacf7c0243007fa lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127360.401710:0:10285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173600/0xeeacf7c0243007fa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127360.401715:0:10285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7c2173600 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:3.0:1789127360.401719:0:10285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173600/0xeeacf7c0243007fa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127360.401725:0:10285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173600/0xeeacf7c0243007fa lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127360.401737:0:10285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8df7906f6b00) 00010000:00010000:3.0:1789127360.401740:0:10285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127360.401868:0:10285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173600/0xeeacf7c0243007fa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127360.401876:0:10285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173600/0xeeacf7c0243007fa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127360.401891:0:10285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024300801 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127360.401897:0:10285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024300801 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127360.401911:0:10285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024300801 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127360.401916:0:10285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df798df1c00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:3.0:1789127360.401919:0:10285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024300801 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127360.401925:0:10285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024300801 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127360.401933:0:10285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8df79f06cf00) 00010000:00010000:3.0:1789127360.401936:0:10285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127360.401939:0:10285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024300801 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127360.401944:0:10285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024300801 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127360.401991:0:10285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173e00/0xeeacf7c0243007f3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b3c expref: 35 pid: 10285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127360.402005:0:10285:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c024300808 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b3c expref: 34 pid: 10285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127360.402012:0:10285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df79f06cb00) 00010000:00010000:3.0:1789127360.402015:0:10285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789127360.402017:0:10285:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df798df0800, rc 0) 00000100:00100000:3.0:1789127360.402082:0:10285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df787b8fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+34:10508:x1876035733848960:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 1032us (1187us total) trans 4294967330 rc 0/0 00000100:00100000:3.0:1789127360.402099:0:10285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 48 00000100:00100000:1.0:1789127360.405620:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127360.406010:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733849088 00000100:00100000:3.0:1789127360.406024:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733849088 00000100:00100000:3.0:1789127360.406107:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 49 00000100:00100000:3.0:1789127360.406121:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeae70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+34:10508:x1876035733849088:12345-192.168.206.40@tcp:54:lfs.0 00010000:00010000:3.0:1789127360.406190:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0e00/0xeeacf7c024300816 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127360.406207:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0e00/0xeeacf7c024300816 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127360.406223:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0e00/0xeeacf7c024300816 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127360.406250:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0e00/0xeeacf7c024300816 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127360.406256:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0e00/0xeeacf7c024300816 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127360.406262:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0e00/0xeeacf7c024300816 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127360.406269:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df798df0e00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:3.0:1789127360.406272:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0e00/0xeeacf7c024300816 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127360.406279:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0e00/0xeeacf7c024300816 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127360.406290:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df79f06cb00) 00010000:00010000:3.0:1789127360.406306:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789127360.406314:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0e00/0xeeacf7c024300816 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127360.406323:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0e00/0xeeacf7c024300816 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127360.406418:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeae70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+34:10508:x1876035733849088:12345-192.168.206.40@tcp:54:lfs.0 Request processed in 300us (805us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127360.406426:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 49 00000100:00100000:1.0:1789127360.409386:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127360.409461:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733849344 00000100:00100000:3.0:1789127360.409472:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733849344 00000100:00100000:3.0:1789127360.409545:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 11 00000100:00100000:3.0:1789127360.409557:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae058b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+34:10508:x1876035733849344:12345-192.168.206.40@tcp:35:lfs.0 00000100:00100000:3.0:1789127360.409843:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae058b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+35:10508:x1876035733849344:12345-192.168.206.40@tcp:35:lfs.0 Request processed in 290us (464us total) trans 4294967331 rc 0/0 00000100:00100000:3.0:1789127360.409851:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 11 00000100:00100000:0.0:1789127360.635134:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127360.635227:0:12098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733849600 00000100:00100000:1.0:1789127360.635237:0:12098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733849600 00000100:00100000:1.0:1789127360.635294:0:12098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 50 00000100:00100000:1.0:1789127360.635303:0:12098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df787b8cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+35:10539:x1876035733849600:12345-192.168.206.40@tcp:101:cat.0 00010000:00010000:1.0:1789127360.635325:0:12098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127360.635345:0:12098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c02430081d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7b43 expref: -99 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127360.635456:0:12098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024300824 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127360.635470:0:12098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024300824 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127360.635481:0:12098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024300824 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789127360.635492:0:12098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1789127360.635625:0:12098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c02430081d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b43 expref: 38 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127360.635656:0:12098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024300824 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b43 expref: 37 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127360.635664:0:12098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df79f06cb00) 00010000:00010000:1.0:1789127360.635666:0:12098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789127360.635669:0:12098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7bbd97e00, rc 0) 00000100:00100000:1.0:1789127360.635734:0:12098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df787b8cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+37:10539:x1876035733849600:12345-192.168.206.40@tcp:101:cat.0 Request processed in 432us (608us total) trans 4294967332 rc 0/0 00000100:00100000:1.0:1789127360.635741:0:12098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 50 00000100:00100000:1.0:1789127360.639311:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127360.639359:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127360.639440:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733849984 00000100:00100000:3.0:1789127360.639449:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733849984 00000100:00100000:3.0:1789127360.639504:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 12 00000100:00100000:3.0:1789127360.639513:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7af5cc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+37:10539:x1876035733849984:12345-192.168.206.40@tcp:35:cat.0 00000100:00100000:3.0:1789127360.639762:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7af5cc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+38:10539:x1876035733849984:12345-192.168.206.40@tcp:35:cat.0 Request processed in 250us (458us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1789127360.639779:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 12 00000100:00100000:2.0:1789127360.639908:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733849728 00000100:00100000:2.0:1789127360.639913:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733849728 00000100:00100000:2.0:1789127360.639949:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 3 00000100:00100000:2.0:1789127360.639956:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7af5ce580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+38:2347:x1876035733849728:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789127360.639966:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789127360.639987:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024300824 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b43 expref: 38 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127360.640002:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df79f06cb00) 00010000:00010000:2.0:1789127360.640007:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789127360.640027:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7af5ce580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+37:2347:x1876035733849728:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 72us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127360.640034:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 3 00000100:00100000:3.0:1789127360.688851:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127360.688956:0:10285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733850240 00000100:00100000:2.0:1789127360.688966:0:10285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733850240 00000100:00100000:2.0:1789127360.689025:0:10285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 51 00000100:00100000:2.0:1789127360.689035:0:10285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6811c6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+37:10545:x1876035733850240:12345-192.168.206.40@tcp:101:dd.0 00010000:00010000:2.0:1789127360.689057:0:10285:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127360.689061:0:10285:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789127360.689086:0:10285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2172c00/0xeeacf7c02430078a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b19 expref: 37 pid: 10285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127360.689105:0:10285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8df7906f6b00) 00010000:00010000:2.0:1789127360.689110:0:10285:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789127360.689138:0:10285:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032da00/0xeeacf7c024300832 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7b4a expref: -99 pid: 10285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127360.689231:0:10285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c400/0xeeacf7c024300839 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127360.689244:0:10285:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c024300808 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b3c expref: 37 pid: 10285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127360.689252:0:10285:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c400/0xeeacf7c024300839 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127360.689283:0:10285:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c024300808 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b3c expref: 37 pid: 10285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127360.689297:0:10285:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c024300808 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b3c expref: 37 pid: 10285 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127360.689309:0:10285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae978780 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10285:1876035752758144:192.168.206.40@tcp:104: 00000100:00100000:2.0:1789127360.689406:0:10285:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7b46bee40 going to sleep for 11 seconds 00000100:00100000:1.0:1789127360.697317:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127360.697421:0:10285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae978780 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10285:1876035752758144:192.168.206.40@tcp:104: 00010000:00010000:2.0:1789127360.697456:0:10285:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c400/0xeeacf7c024300839 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127360.697577:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733850368 00000100:00100000:3.0:1789127360.697584:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733850368 00010000:00010000:3.0:1789127360.697620:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c024300808 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b3c expref: 38 pid: 10285 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127360.697674:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 43 00000100:00100000:3.0:1789127360.697683:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7af5cf840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+38:2349:x1876035733850368:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789127360.697697:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127360.697703:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c024300808 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b3c expref: 38 pid: 10285 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127360.697725:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c024300808 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b3c expref: 38 pid: 10285 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127360.697753:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c024300808 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b3c expref: 38 pid: 10285 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127360.697778:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df79f06cb00) 00010000:00010000:3.0:1789127360.697783:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c400/0xeeacf7c024300839 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127360.697834:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c400/0xeeacf7c024300839 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127360.697841:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c400/0xeeacf7c024300839 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127360.697862:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127360.697909:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7af5cf840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+37:2349:x1876035733850368:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 225us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127360.697917:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 43 00010000:00010000:1.0:1789127360.698639:0:10285:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c400/0xeeacf7c024300839 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127360.698650:0:10285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c400/0xeeacf7c024300839 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789127360.698669:0:10285:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1789127360.698879:0:10285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032da00/0xeeacf7c024300832 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b4a expref: 38 pid: 10285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127360.698897:0:10285:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c400/0xeeacf7c024300839 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b4a expref: 37 pid: 10285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127360.698905:0:10285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df79f06cb00) 00010000:00010000:1.0:1789127360.698908:0:10285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789127360.698920:0:10285:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df79032c400, rc 0) 00000100:00100000:1.0:1789127360.698966:0:10285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6811c6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+37:10545:x1876035733850240:12345-192.168.206.40@tcp:101:dd.0 Request processed in 9932us (10122us total) trans 4294967334 rc 0/0 00000100:00100000:1.0:1789127360.698973:0:10285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 51 00000100:00100000:1.0:1789127360.702842:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127360.702917:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733850624 00000100:00100000:2.0:1789127360.702927:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733850624 00000100:00100000:2.0:1789127360.702983:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 52 00000100:00100000:2.0:1789127360.702995:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7af5ccb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+37:10545:x1876035733850624:12345-192.168.206.40@tcp:36:dd.0 00010000:00010000:2.0:1789127360.703237:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c024300847 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127360.703265:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c024300847 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127360.703277:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c024300847 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789127360.703327:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967335 00000004:00010000:2.0:1789127360.703351:0:5832:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000209d330a reply state 0000000090cd89af transno 4294967336 ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c024300847 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127360.703359:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789127360.703554:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7af5ccb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+40:10545:x1876035733850624:12345-192.168.206.40@tcp:36:dd.0 Request processed in 560us (719us total) trans 4294967336 rc 0/0 00000100:00100000:2.0:1789127360.703562:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 52 00000020:00080000:2.0:1789127360.703566:0:5832:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789127360.706124:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c024300847 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127360.706141:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c024300847 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127360.706147:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c024300847 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127360.706154:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df79032c200 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:0.0:1789127360.706173:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c024300847 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127360.706180:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c024300847 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127360.706197:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df79f06cb00) 00010000:00010000:0.0:1789127360.706200:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127360.706205:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c024300847 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127360.706211:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c024300847 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127360.908733:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127360.911116:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733850752 00000100:00100000:0.0:1789127360.911128:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733850752 00000100:00100000:0.0:1789127360.911202:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 53 00000100:00100000:0.0:1789127360.911213:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7af5ced00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+39:10559:x1876035733850752:12345-192.168.206.40@tcp:101:stat.0 00010000:00010000:0.0:1789127360.911239:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127360.911259:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729000/0xeeacf7c02430084e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7b51 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127360.911320:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728e00/0xeeacf7c024300855 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127360.911333:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728e00/0xeeacf7c024300855 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127360.911345:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728e00/0xeeacf7c024300855 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127360.911360:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c02430085c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127360.911381:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c02430085c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127360.911387:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c02430085c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127360.911482:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c024300863 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127360.911493:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c400/0xeeacf7c024300839 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b4a expref: 40 pid: 10285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127360.911501:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c024300863 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127360.912659:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c400/0xeeacf7c024300839 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b4a expref: 40 pid: 10285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127360.912677:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c400/0xeeacf7c024300839 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b4a expref: 40 pid: 10285 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127360.912691:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df787b8f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5831:1876035752758272:192.168.206.40@tcp:104: 00000100:00100000:0.0:1789127360.912936:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7af618480 going to sleep for 11 seconds 00000100:00100000:0.0:1789127360.917098:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df787b8f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5831:1876035752758272:192.168.206.40@tcp:104: 00010000:00010000:0.0:1789127360.917126:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c024300863 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127360.919978:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127360.920067:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733851008 00000100:00100000:3.0:1789127360.920089:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733851008 00000100:00100000:0.0:1789127360.920244:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 13 00000100:00100000:0.0:1789127360.920263:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7af5cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+41:10147:x1876035733851008:12345-192.168.206.40@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789127360.922818:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7af5cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+42:10147:x1876035733851008:12345-192.168.206.40@tcp:35:ldlm_bl.0 Request processed in 1454us (1745us total) trans 4294967337 rc 0/0 00000100:00100000:0.0:1789127360.922834:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 13 00000100:00100000:3.0:1789127360.924072:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127360.924180:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733851136 00000100:00100000:2.0:1789127360.924190:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733851136 00010000:00010000:2.0:1789127360.924226:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c400/0xeeacf7c024300839 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b4a expref: 42 pid: 10285 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127360.924272:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 44 00000100:00100000:2.0:1789127360.924282:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7889ca450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+42:2349:x1876035733851136:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789127360.924296:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789127360.924303:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c400/0xeeacf7c024300839 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b4a expref: 42 pid: 10285 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127360.924317:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c400/0xeeacf7c024300839 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b4a expref: 42 pid: 10285 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127360.924360:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c400/0xeeacf7c024300839 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b4a expref: 42 pid: 10285 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127360.924376:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df79f06cb00) 00010000:00010000:2.0:1789127360.924381:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c024300863 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127360.924390:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c024300863 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127360.924399:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c024300863 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127360.924441:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789127360.924497:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7889ca450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+41:2349:x1876035733851136:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 216us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127360.924505:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 44 00010000:00010000:1.0:1789127360.924915:0:5831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c024300863 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127360.924925:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c024300863 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789127360.924969:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1789127360.924973:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789127360.925012:0:5831:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c024300863 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127360.925026:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c024300863 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127360.925035:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728e00/0xeeacf7c024300855 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127360.925041:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728e00/0xeeacf7c024300855 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127360.925047:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728e00/0xeeacf7c024300855 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127360.925054:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7ae728e00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:1.0:1789127360.925057:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728e00/0xeeacf7c024300855 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127360.925073:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728e00/0xeeacf7c024300855 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127360.925083:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8df7906f6b00) 00010000:00010000:1.0:1789127360.925086:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789127360.925090:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728e00/0xeeacf7c024300855 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127360.925097:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728e00/0xeeacf7c024300855 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127360.925112:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c02430085c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127360.925117:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c02430085c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127360.925123:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c02430085c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127360.925128:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7ae729c00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:1.0:1789127360.925130:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c02430085c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127360.925136:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c02430085c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127360.925142:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8df782a68a00) 00010000:00010000:1.0:1789127360.925159:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789127360.925163:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c02430085c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127360.925179:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c02430085c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127360.925216:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729000/0xeeacf7c02430084e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b51 expref: 41 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127360.925229:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c024300863 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b51 expref: 40 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127360.925237:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df79f06cb00) 00010000:00010000:1.0:1789127360.925239:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789127360.925242:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7ae729e00, rc 0) 00000100:00100000:1.0:1789127360.925288:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7af5ced00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+40:10559:x1876035733850752:12345-192.168.206.40@tcp:101:stat.0 Request processed in 14076us (16564us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127360.925308:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 53 00010000:00010000:3.0:1789127360.947100:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127361.006676:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127361.006912:0:10285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733851392 00000100:00100000:1.0:1789127361.006928:0:10285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733851392 00000100:00100000:1.0:1789127361.007004:0:10285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 54 00000100:00100000:1.0:1789127361.007015:0:10285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6811c7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+40:10565:x1876035733851392:12345-192.168.206.40@tcp:36:truncate.0 00010000:00010000:1.0:1789127361.007068:0:10285:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789127361.007093:0:10285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c024300863 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b51 expref: 40 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.007110:0:10285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df79f06cb00) 00010000:00010000:1.0:1789127361.007115:0:10285:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789127361.007299:0:10285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97a00/0xeeacf7c02430086a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.007325:0:10285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97a00/0xeeacf7c02430086a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.007336:0:10285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97a00/0xeeacf7c02430086a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789127361.007386:0:10285:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967338 00000004:00010000:1.0:1789127361.007407:0:10285:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000893f2114 reply state 00000000e5a82b0d transno 4294967339 ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97a00/0xeeacf7c02430086a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127361.007415:0:10285:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789127361.007555:0:10285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6811c7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+42:10565:x1876035733851392:12345-192.168.206.40@tcp:36:truncate.0 Request processed in 542us (888us total) trans 4294967339 rc 0/0 00000100:00100000:1.0:1789127361.007564:0:10285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 54 00000020:00080000:1.0:1789127361.007568:0:10285:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:0.0:1789127361.007956:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789127361.013406:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97a00/0xeeacf7c02430086a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127361.013424:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97a00/0xeeacf7c02430086a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127361.013432:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97a00/0xeeacf7c02430086a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127361.013439:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd97a00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:2.0:1789127361.013444:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97a00/0xeeacf7c02430086a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127361.013470:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97a00/0xeeacf7c02430086a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127361.013485:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df79f06cb00) 00010000:00010000:2.0:1789127361.013488:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789127361.013493:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97a00/0xeeacf7c02430086a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127361.013499:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97a00/0xeeacf7c02430086a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127361.129826:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127361.129926:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733851520 00000100:00100000:2.0:1789127361.129936:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733851520 00000100:00100000:2.0:1789127361.129996:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 55 00000100:00100000:2.0:1789127361.130006:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeb161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+41:10579:x1876035733851520:12345-192.168.206.40@tcp:101:stat.0 00010000:00010000:2.0:1789127361.130029:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127361.130048:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032ca00/0xeeacf7c024300871 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7b58 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127361.130110:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032dc00/0xeeacf7c024300878 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127361.130124:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032dc00/0xeeacf7c024300878 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127361.130135:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032dc00/0xeeacf7c024300878 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127361.130148:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c800/0xeeacf7c02430087f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127361.130168:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c800/0xeeacf7c02430087f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127361.130175:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c800/0xeeacf7c02430087f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127361.130268:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c400/0xeeacf7c024300886 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127361.130278:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c400/0xeeacf7c024300886 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127361.130285:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c400/0xeeacf7c024300886 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789127361.130317:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:2.0:1789127361.130321:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789127361.130354:0:5832:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c400/0xeeacf7c024300886 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127361.130367:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c400/0xeeacf7c024300886 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127361.130376:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032dc00/0xeeacf7c024300878 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127361.130381:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032dc00/0xeeacf7c024300878 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127361.130388:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032dc00/0xeeacf7c024300878 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127361.130403:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df79032dc00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:2.0:1789127361.130407:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032dc00/0xeeacf7c024300878 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127361.130416:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032dc00/0xeeacf7c024300878 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127361.130428:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8df7906f6b00) 00010000:00010000:2.0:1789127361.130431:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789127361.130436:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032dc00/0xeeacf7c024300878 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127361.130442:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032dc00/0xeeacf7c024300878 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127361.130456:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c800/0xeeacf7c02430087f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127361.130462:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c800/0xeeacf7c02430087f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127361.130468:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c800/0xeeacf7c02430087f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127361.130473:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df79032c800 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:2.0:1789127361.130476:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c800/0xeeacf7c02430087f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127361.130481:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c800/0xeeacf7c02430087f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127361.130500:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8df7906f6600) 00010000:00010000:2.0:1789127361.130502:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789127361.130506:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c800/0xeeacf7c02430087f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127361.130511:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c800/0xeeacf7c02430087f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127361.130543:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032ca00/0xeeacf7c024300871 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b58 expref: 43 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127361.130556:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c400/0xeeacf7c024300886 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b58 expref: 42 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127361.130563:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df79f06cb00) 00010000:00010000:2.0:1789127361.130566:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789127361.130568:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df79032c400, rc 0) 00000100:00100000:2.0:1789127361.130638:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeb161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+42:10579:x1876035733851520:12345-192.168.206.40@tcp:101:stat.0 Request processed in 632us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127361.130645:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 55 00000100:00100000:3.0:1789127361.212589:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127361.212691:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733851776 00000100:00100000:1.0:1789127361.212700:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733851776 00000100:00100000:1.0:1789127361.212775:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 56 00000100:00100000:1.0:1789127361.212819:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeb152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+42:10589:x1876035733851776:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:1.0:1789127361.212839:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127361.212861:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c02430088d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7b5f expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789127361.212967:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1789127361.213079:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c02430088d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b5f expref: 44 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.213094:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df782d66900) 00010000:00010000:1.0:1789127361.213109:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789127361.213114:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c02430088d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b5f expref: 44 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.213128:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7bbd96000, rc 0) 00000100:00100000:1.0:1789127361.213189:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeb152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+43:10589:x1876035733851776:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 403us (609us total) trans 4294967340 rc 301/301 00000100:00100000:1.0:1789127361.213196:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 56 00000100:00100000:0.0:1789127361.217510:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127361.217633:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733852032 00000100:00100000:3.0:1789127361.217642:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733852032 00000100:00100000:3.0:1789127361.217699:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 14 00000100:00100000:3.0:1789127361.217709:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df787b8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+43:10589:x1876035733852032:12345-192.168.206.40@tcp:35:lfs.0 00000100:00100000:3.0:1789127361.218018:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df787b8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+44:10589:x1876035733852032:12345-192.168.206.40@tcp:35:lfs.0 Request processed in 309us (516us total) trans 4294967341 rc 0/0 00000100:00100000:3.0:1789127361.218026:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 14 00000100:00100000:3.0:1789127361.270494:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127361.270608:0:12098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733852288 00000100:00100000:1.0:1789127361.270618:0:12098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733852288 00000100:00100000:1.0:1789127361.270676:0:12098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 57 00000100:00100000:1.0:1789127361.270685:0:12098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeb15e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+44:10595:x1876035733852288:12345-192.168.206.40@tcp:101:bash.0 00010000:00010000:1.0:1789127361.270707:0:12098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127361.270728:0:12098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c02430089b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7b66 expref: -99 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.270860:0:12098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96200/0xeeacf7c0243008a2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.270876:0:12098:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c400/0xeeacf7c024300886 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b58 expref: 45 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.270884:0:12098:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96200/0xeeacf7c0243008a2 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.270918:0:12098:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c400/0xeeacf7c024300886 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b58 expref: 45 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.270930:0:12098:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c400/0xeeacf7c024300886 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b58 expref: 45 pid: 5832 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127361.270957:0:12098:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7af5cfc00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12098:1876035752758400:192.168.206.40@tcp:104: 00000100:00100000:1.0:1789127361.271044:0:12098:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7bbd936c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789127361.274723:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127361.275304:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733852416 00000100:00100000:2.0:1789127361.275314:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733852416 00010000:00010000:2.0:1789127361.275353:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c400/0xeeacf7c024300886 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b58 expref: 46 pid: 5832 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127361.275395:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 45 00000100:00100000:2.0:1789127361.275406:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7af5ccf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+46:2349:x1876035733852416:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789127361.275449:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789127361.275457:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c400/0xeeacf7c024300886 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b58 expref: 46 pid: 5832 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127361.275471:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c400/0xeeacf7c024300886 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b58 expref: 46 pid: 5832 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127361.275497:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df79f06cb00) 00010000:00010000:2.0:1789127361.275502:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96200/0xeeacf7c0243008a2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127361.275512:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96200/0xeeacf7c0243008a2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127361.275519:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96200/0xeeacf7c0243008a2 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127361.275537:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789127361.275559:0:12098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c400/0xeeacf7c024300886 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b58 expref: 46 pid: 5832 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127361.275576:0:12098:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7af5cfc00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12098:1876035752758400:192.168.206.40@tcp:104: 00000100:00100000:2.0:1789127361.275592:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7af5ccf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+45:2349:x1876035733852416:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 189us (878us total) trans 0 rc 0/0 00010000:00010000:3.0:1789127361.275595:0:12098:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96200/0xeeacf7c0243008a2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127361.275600:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 45 00010000:00010000:3.0:1789127361.275603:0:12098:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96200/0xeeacf7c0243008a2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127361.275608:0:12098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96200/0xeeacf7c0243008a2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789127361.275624:0:12098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:3.0:1789127361.275784:0:12098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c02430089b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b66 expref: 46 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127361.275841:0:12098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96200/0xeeacf7c0243008a2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b66 expref: 45 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127361.275848:0:12098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df79f06cb00) 00010000:00010000:3.0:1789127361.275851:0:12098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789127361.275853:0:12098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7bbd96200, rc 0) 00000100:00100000:3.0:1789127361.275891:0:12098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeb15e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+45:10595:x1876035733852288:12345-192.168.206.40@tcp:101:bash.0 Request processed in 5206us (5405us total) trans 4294967342 rc 0/0 00000100:00100000:3.0:1789127361.275897:0:12098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 57 00000100:00100000:1.0:1789127361.281031:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127361.281150:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733852672 00000100:00100000:3.0:1789127361.281159:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733852672 00000100:00100000:3.0:1789127361.281217:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 58 00000100:00100000:3.0:1789127361.281227:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7af5cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+45:10595:x1876035733852672:12345-192.168.206.40@tcp:36:bash.0 00010000:00010000:3.0:1789127361.281494:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c0243008b0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127361.281511:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c0243008b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127361.281523:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c0243008b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789127361.281572:0:5830:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967343 00000004:00010000:3.0:1789127361.281596:0:5830:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000000286b50a reply state 000000004f332a07 transno 4294967344 ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c0243008b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127361.281604:0:5830:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789127361.281728:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7af5cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+48:10595:x1876035733852672:12345-192.168.206.40@tcp:36:bash.0 Request processed in 501us (704us total) trans 4294967344 rc 0/0 00000100:00100000:3.0:1789127361.281735:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 58 00000020:00080000:3.0:1789127361.282294:0:5830:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789127361.284099:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c0243008b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127361.284114:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c0243008b0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127361.284121:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c0243008b0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127361.284126:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df798df1c00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:3.0:1789127361.284131:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c0243008b0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127361.284138:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c0243008b0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127361.284155:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df79f06cb00) 00010000:00010000:3.0:1789127361.284158:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127361.284164:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c0243008b0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127361.284170:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c0243008b0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127361.288418:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127361.288670:0:10285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733852800 00000100:00100000:2.0:1789127361.288681:0:10285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733852800 00000100:00100000:2.0:1789127361.288746:0:10285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 59 00000100:00100000:2.0:1789127361.288757:0:10285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7af5ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+47:10595:x1876035733852800:12345-192.168.206.40@tcp:101:bash.0 00010000:00010000:2.0:1789127361.288830:0:10285:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127361.288854:0:10285:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c800/0xeeacf7c0243008b7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7b6d expref: -99 pid: 10285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127361.288972:0:10285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032dc00/0xeeacf7c0243008be lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127361.288984:0:10285:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96200/0xeeacf7c0243008a2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b66 expref: 48 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127361.288993:0:10285:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032dc00/0xeeacf7c0243008be lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127361.289025:0:10285:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96200/0xeeacf7c0243008a2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b66 expref: 48 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127361.289038:0:10285:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96200/0xeeacf7c0243008a2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b66 expref: 48 pid: 12098 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127361.289052:0:10285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae97a1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10285:1876035752758528:192.168.206.40@tcp:104: 00000100:00100000:2.0:1789127361.289132:0:10285:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7b46be600 going to sleep for 11 seconds 00000100:00100000:2.0:1789127361.292759:0:10285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae97a1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10285:1876035752758528:192.168.206.40@tcp:104: 00010000:00010000:2.0:1789127361.292825:0:10285:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032dc00/0xeeacf7c0243008be lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127361.294377:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127361.294689:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733852928 00000100:00100000:2.0:1789127361.294698:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733852928 00010000:00010000:2.0:1789127361.294753:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96200/0xeeacf7c0243008a2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b66 expref: 49 pid: 12098 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127361.294830:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 46 00000100:00100000:2.0:1789127361.294854:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7af5cd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+49:2349:x1876035733852928:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789127361.294869:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789127361.294877:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96200/0xeeacf7c0243008a2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b66 expref: 49 pid: 12098 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127361.294890:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96200/0xeeacf7c0243008a2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b66 expref: 49 pid: 12098 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127361.294911:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96200/0xeeacf7c0243008a2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b66 expref: 49 pid: 12098 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127361.294926:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df79f06cb00) 00010000:00010000:2.0:1789127361.294932:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032dc00/0xeeacf7c0243008be lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127361.294941:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032dc00/0xeeacf7c0243008be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127361.294947:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032dc00/0xeeacf7c0243008be lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127361.294969:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789127361.295168:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7af5cd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+48:2349:x1876035733852928:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 315us (795us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127361.295176:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 46 00010000:00010000:1.0:1789127361.295280:0:10285:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032dc00/0xeeacf7c0243008be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.295288:0:10285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032dc00/0xeeacf7c0243008be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789127361.295334:0:10285:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1789127361.295338:0:10285:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789127361.295358:0:10285:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032dc00/0xeeacf7c0243008be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.295388:0:10285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c800/0xeeacf7c0243008b7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b6d expref: 48 pid: 10285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.295404:0:10285:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032dc00/0xeeacf7c0243008be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b6d expref: 47 pid: 10285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.295411:0:10285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df79f06cb00) 00010000:00010000:1.0:1789127361.295413:0:10285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789127361.295415:0:10285:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df79032dc00, rc 0) 00000100:00100000:1.0:1789127361.295445:0:10285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7af5ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+47:10595:x1876035733852800:12345-192.168.206.40@tcp:101:bash.0 Request processed in 6690us (7035us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127361.295462:0:10285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 59 00000100:00100000:3.0:1789127361.298647:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127361.298720:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733853184 00000100:00100000:2.0:1789127361.298731:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733853184 00000100:00100000:2.0:1789127361.298820:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 15 00000100:00100000:2.0:1789127361.298831:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df791568850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+47:10595:x1876035733853184:12345-192.168.206.40@tcp:35:bash.0 00000100:00100000:2.0:1789127361.299636:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df791568850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+48:10595:x1876035733853184:12345-192.168.206.40@tcp:35:bash.0 Request processed in 801us (991us total) trans 4294967345 rc 0/0 00000100:00100000:2.0:1789127361.299646:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 15 00000100:00100000:3.0:1789127361.377248:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127361.377349:0:12098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733853440 00000100:00100000:1.0:1789127361.377361:0:12098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733853440 00000100:00100000:1.0:1789127361.377422:0:12098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 60 00000100:00100000:1.0:1789127361.377432:0:12098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeb15a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+48:10605:x1876035733853440:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:1.0:1789127361.377456:0:12098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127361.377476:0:12098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c0243008c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7b74 expref: -99 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789127361.377585:0:12098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1789127361.377706:0:12098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c0243008c5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b74 expref: 50 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.377721:0:12098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df782d66900) 00010000:00010000:1.0:1789127361.377724:0:12098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789127361.377730:0:12098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c0243008c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b74 expref: 50 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.377755:0:12098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7bbd96600, rc 0) 00000100:00100000:1.0:1789127361.377882:0:12098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeb15a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+49:10605:x1876035733853440:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 451us (642us total) trans 4294967346 rc 301/301 00000100:00100000:1.0:1789127361.377891:0:12098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 60 00000100:00100000:0.0:1789127361.381863:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127361.382213:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733853568 00000100:00100000:1.0:1789127361.382222:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733853568 00000100:00100000:1.0:1789127361.382276:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 61 00000100:00100000:1.0:1789127361.382284:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df787b8e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+49:10605:x1876035733853568:12345-192.168.206.40@tcp:34:lfs.0 00010000:00010000:1.0:1789127361.382372:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c0243008d3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.382388:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c0243008d3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.382400:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c0243008d3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.382415:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c0243008da lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.382422:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c0243008da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.382428:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c0243008da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.382533:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c0243008e1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.382542:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c0243008e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.382550:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c0243008e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789127361.382589:0:5831:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c0243008e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.382601:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c0243008d3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.382617:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c0243008d3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.382624:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c0243008d3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.382630:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd96600 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:1.0:1789127361.382633:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c0243008d3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.382641:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c0243008d3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.382652:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8df7906f6b00) 00010000:00010000:1.0:1789127361.382654:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789127361.382658:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c0243008d3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.382664:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c0243008d3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.382674:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c0243008da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.382679:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c0243008da lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.382684:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c0243008da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.382687:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd97600 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:1.0:1789127361.382695:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c0243008da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.382701:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c0243008da lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.382921:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8df782d66b00) 00010000:00010000:1.0:1789127361.382926:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789127361.382930:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c0243008da lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.382936:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c0243008da lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.382951:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c0243008e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.382956:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c0243008e1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.382961:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c0243008e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.382966:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd97800 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:1.0:1789127361.382969:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c0243008e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.382975:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c0243008e1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.382983:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df79f06cb00) 00010000:00010000:1.0:1789127361.382985:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789127361.382995:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c0243008e1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.383002:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c0243008e1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127361.383114:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df787b8e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+49:10605:x1876035733853568:12345-192.168.206.40@tcp:34:lfs.0 Request processed in 828us (1258us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127361.383123:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 61 00000100:00100000:3.0:1789127361.385286:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127361.385343:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733853824 00000100:00100000:1.0:1789127361.385351:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733853824 00000100:00100000:1.0:1789127361.385403:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 16 00000100:00100000:1.0:1789127361.385412:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeb14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+49:10605:x1876035733853824:12345-192.168.206.40@tcp:35:lfs.0 00000100:00100000:1.0:1789127361.386080:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeb14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+50:10605:x1876035733853824:12345-192.168.206.40@tcp:35:lfs.0 Request processed in 665us (797us total) trans 4294967347 rc 0/0 00000100:00100000:1.0:1789127361.386089:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 16 00000100:00100000:3.0:1789127361.417189:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127361.417292:0:10285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733854080 00000100:00100000:1.0:1789127361.417300:0:10285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733854080 00000100:00100000:1.0:1789127361.417351:0:10285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 62 00000100:00100000:1.0:1789127361.417360:0:10285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeb143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+50:10608:x1876035733854080:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:1.0:1789127361.417383:0:10285:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127361.417406:0:10285:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c0243008e8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7b7b expref: -99 pid: 10285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.417490:0:10285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c0243008ef lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.417505:0:10285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c0243008ef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.417525:0:10285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c0243008ef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.417540:0:10285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c0243008f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.417547:0:10285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c0243008f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.417554:0:10285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c0243008f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.417657:0:10285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96200/0xeeacf7c0243008fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.417664:0:10285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96200/0xeeacf7c0243008fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.417671:0:10285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96200/0xeeacf7c0243008fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789127361.417680:0:10285:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1789127361.417783:0:10285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c0243008ef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.417824:0:10285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c0243008ef lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.417831:0:10285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c0243008ef lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.417836:0:10285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd97600 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:1.0:1789127361.417845:0:10285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c0243008ef lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.417853:0:10285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c0243008ef lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.417864:0:10285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8df7906f6b00) 00010000:00010000:1.0:1789127361.417867:0:10285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789127361.417872:0:10285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c0243008ef lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.417878:0:10285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c0243008ef lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.417890:0:10285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c0243008f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.417896:0:10285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c0243008f6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.417901:0:10285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c0243008f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.417906:0:10285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd96600 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:1.0:1789127361.417909:0:10285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c0243008f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.417915:0:10285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c0243008f6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.417921:0:10285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8df782d66b00) 00010000:00010000:1.0:1789127361.417923:0:10285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789127361.417930:0:10285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c0243008f6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.417936:0:10285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c0243008f6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.417971:0:10285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c0243008e8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b7b expref: 53 pid: 10285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.417983:0:10285:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96200/0xeeacf7c0243008fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b7b expref: 52 pid: 10285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.417991:0:10285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df79f06cb00) 00010000:00010000:1.0:1789127361.417993:0:10285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789127361.417995:0:10285:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7bbd96200, rc 0) 00000100:00100000:1.0:1789127361.418049:0:10285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeb143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+52:10608:x1876035733854080:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 690us (869us total) trans 4294967348 rc 0/0 00000100:00100000:1.0:1789127361.418056:0:10285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 62 00000100:00100000:0.0:1789127361.421904:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127361.421947:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127361.422037:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733854336 00000100:00100000:2.0:1789127361.422048:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733854336 00000100:00100000:2.0:1789127361.422113:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 4 00000100:00100000:2.0:1789127361.422124:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df787b8de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+52:2348:x1876035733854336:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789127361.422139:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789127361.422167:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96200/0xeeacf7c0243008fd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b7b expref: 52 pid: 10285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127361.422187:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df79f06cb00) 00010000:00010000:2.0:1789127361.422192:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789127361.422244:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df787b8de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+51:2348:x1876035733854336:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 122us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127361.422253:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 4 00000100:00100000:3.0:1789127361.422531:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733854208 00000100:00100000:3.0:1789127361.422536:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733854208 00000100:00100000:3.0:1789127361.422576:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 63 00000100:00100000:3.0:1789127361.422584:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df787b8d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+51:10608:x1876035733854208:12345-192.168.206.40@tcp:54:lfs.0 00010000:00010000:3.0:1789127361.422639:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c02430090b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127361.422653:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c02430090b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127361.422663:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c02430090b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127361.422687:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c02430090b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127361.422694:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c02430090b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127361.422700:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c02430090b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127361.422706:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df798df1c00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:3.0:1789127361.422710:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c02430090b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127361.422717:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c02430090b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127361.422725:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df79f06cb00) 00010000:00010000:3.0:1789127361.422728:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789127361.422745:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c02430090b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127361.422751:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c02430090b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127361.422850:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df787b8d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+51:10608:x1876035733854208:12345-192.168.206.40@tcp:54:lfs.0 Request processed in 266us (954us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127361.422857:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 63 00000100:00100000:0.0:1789127361.426569:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127361.426892:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733854592 00000100:00100000:3.0:1789127361.426901:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733854592 00000100:00100000:3.0:1789127361.426957:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 17 00000100:00100000:3.0:1789127361.426966:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df787b8da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+51:10608:x1876035733854592:12345-192.168.206.40@tcp:35:lfs.0 00000100:00100000:3.0:1789127361.427179:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df787b8da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+52:10608:x1876035733854592:12345-192.168.206.40@tcp:35:lfs.0 Request processed in 212us (618us total) trans 4294967349 rc 0/0 00000100:00100000:3.0:1789127361.427187:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 17 00000100:00100000:0.0:1789127361.546906:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127361.547083:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733854848 00000100:00100000:1.0:1789127361.547093:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733854848 00000100:00100000:1.0:1789127361.547246:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 64 00000100:00100000:1.0:1789127361.547258:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df787b8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+52:10626:x1876035733854848:12345-192.168.206.40@tcp:101:cat.0 00010000:00010000:1.0:1789127361.547281:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127361.547301:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c024300912 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7b82 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.547420:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c024300919 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.547462:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c024300919 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.547473:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c024300919 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789127361.547485:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1789127361.547601:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c024300912 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b82 expref: 55 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.547619:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c024300919 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b82 expref: 54 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.547626:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df79f06cb00) 00010000:00010000:1.0:1789127361.547629:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789127361.547632:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7bbd96600, rc 0) 00000100:00100000:1.0:1789127361.547696:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df787b8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+54:10626:x1876035733854848:12345-192.168.206.40@tcp:101:cat.0 Request processed in 441us (799us total) trans 4294967350 rc 0/0 00000100:00100000:1.0:1789127361.547704:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 64 00000100:00100000:0.0:1789127361.572747:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127361.572973:0:12098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733854976 00000100:00100000:3.0:1789127361.572983:0:12098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733854976 00000100:00100000:3.0:1789127361.573046:0:12098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 65 00000100:00100000:3.0:1789127361.573056:0:12098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df787b8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+54:10627:x1876035733854976:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:3.0:1789127361.573079:0:12098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127361.573099:0:12098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024300927 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7b89 expref: -99 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127361.573160:0:12098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c02430092e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127361.573174:0:12098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c02430092e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127361.573201:0:12098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c02430092e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789127361.573265:0:12098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:3.0:1789127361.573269:0:12098:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1789127361.573291:0:12098:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c02430092e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127361.573315:0:12098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024300927 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b89 expref: 56 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127361.573332:0:12098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c02430092e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b89 expref: 55 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127361.573340:0:12098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8df7906f6b00) 00010000:00010000:3.0:1789127361.573343:0:12098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789127361.573346:0:12098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df798df0800, rc 0) 00000100:00100000:3.0:1789127361.573994:0:12098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df787b8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+55:10627:x1876035733854976:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 351us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127361.574005:0:12098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 65 00000100:00100000:0.0:1789127361.580902:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127361.581056:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733855360 00000100:00100000:3.0:1789127361.581065:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733855360 00000100:00100000:3.0:1789127361.581167:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 18 00000100:00100000:3.0:1789127361.581177:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df787b8e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+55:10627:x1876035733855360:12345-192.168.206.40@tcp:35:lfs.0 00000100:00100000:3.0:1789127361.581494:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df787b8e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+56:10627:x1876035733855360:12345-192.168.206.40@tcp:35:lfs.0 Request processed in 316us (600us total) trans 4294967351 rc 0/0 00000100:00100000:3.0:1789127361.581502:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 18 00000100:00100000:0.0:1789127361.584674:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127361.584778:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733855488 00000100:00100000:2.0:1789127361.584809:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733855488 00000100:00100000:2.0:1789127361.584874:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 5 00000100:00100000:2.0:1789127361.584884:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df787b8f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+56:10627:x1876035733855488:12345-192.168.206.40@tcp:103:lfs.0 00010000:00010000:2.0:1789127361.584899:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789127361.584924:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032dc00/0xeeacf7c0243008be lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b6d expref: 56 pid: 10285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127361.584944:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c024300919 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b82 expref: 55 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127361.584979:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173000/0xeeacf7c0243007c9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b2e expref: 54 pid: 10285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127361.584988:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df79f06cb00) 00010000:00010000:2.0:1789127361.584998:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789127361.585050:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df787b8f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+53:10627:x1876035733855488:12345-192.168.206.40@tcp:103:lfs.0 Request processed in 168us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127361.585058:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 5 00000100:00100000:0.0:1789127361.588027:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127361.588450:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733855616 00000100:00100000:2.0:1789127361.588460:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733855616 00000100:00100000:2.0:1789127361.588681:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 66 00000100:00100000:2.0:1789127361.588692:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df787b8d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+53:10627:x1876035733855616:12345-192.168.206.40@tcp:58:lfs.0 00010000:00010000:2.0:1789127361.588857:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032da00/0xeeacf7c024300935 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127361.588872:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032da00/0xeeacf7c024300935 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127361.588884:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032da00/0xeeacf7c024300935 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789127361.589161:0:5832:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789127361.589362:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1789127361.589435:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1789127361.589566:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df787b8d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+53:10627:x1876035733855616:12345-192.168.206.40@tcp:58:lfs.0 Request processed in 872us (1541us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127361.589577:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 66 00000100:00100000:0.0:1789127361.610317:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127361.610413:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733855744 00000100:00100000:1.0:1789127361.610425:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733855744 00000100:00100000:1.0:1789127361.610500:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 67 00000100:00100000:1.0:1789127361.610509:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df787b8f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+53:10629:x1876035733855744:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:1.0:1789127361.610528:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127361.610550:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c02430093c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7b90 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.610638:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c024300943 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.610652:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c024300943 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.610663:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c024300943 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.610676:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c02430094a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.610682:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c02430094a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.610688:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c02430094a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.610826:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024300951 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.610836:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024300951 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.610844:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024300951 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789127361.610875:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1789127361.610880:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789127361.610895:0:5831:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024300951 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.610915:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024300951 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.610923:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c024300943 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.610929:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c024300943 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.610935:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c024300943 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.610941:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd97600 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:1.0:1789127361.610945:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c024300943 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.610952:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c024300943 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.610963:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8df7906f6b00) 00010000:00010000:1.0:1789127361.610966:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789127361.610970:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c024300943 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.610977:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c024300943 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.610989:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c02430094a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.610995:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c02430094a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.611008:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c02430094a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.611013:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd96000 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:1.0:1789127361.611016:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c02430094a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.611022:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c02430094a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.611029:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8df782d66b00) 00010000:00010000:1.0:1789127361.611031:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789127361.611034:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c02430094a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.611039:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c02430094a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.611070:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c02430093c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b90 expref: 55 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.611082:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024300951 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b90 expref: 54 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127361.611089:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df7906f6600) 00010000:00010000:1.0:1789127361.611091:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789127361.611094:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7bbd97e00, rc 0) 00000100:00100000:1.0:1789127361.611141:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df787b8f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+54:10629:x1876035733855744:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 633us (833us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127361.611158:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 67 00010000:00010000:0.0:1789127361.972552:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789127362.299533:0:12397:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789127362.299542:0:12397:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789127362.299580:0:12397:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1789127362.299586:0:12397:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1789127362.420459:0:12084:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789127362.420467:0:12084:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789127362.420519:0:12084:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1789127362.420525:0:12084:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789127362.420648:0:12084:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df787b8cb40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12084:1876035752758656:192.168.206.40@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789127362.420742:0:12084:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7889e9f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789127362.430959:0:12084:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df787b8cb40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12084:1876035752758656:192.168.206.40@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789127362.438025:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127362.438502:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733855872 00000100:00100000:2.0:1789127362.438512:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733855872 00000100:00100000:2.0:1789127362.438567:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 1 00000100:00100000:2.0:1789127362.438576:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7af5cde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:28762f98-a240-4662-a754-e28bbeb6cb4b+54:10641:x1876035733855872:12345-192.168.206.40@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1789127362.438704:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7af5cde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:28762f98-a240-4662-a754-e28bbeb6cb4b+54:10641:x1876035733855872:12345-192.168.206.40@tcp:900:lhsmtool_posix.0 Request processed in 128us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127362.438722:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 1 00000100:00100000:2.0:1789127362.440685:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127362.440751:0:12098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733856000 00000100:00100000:3.0:1789127362.440760:0:12098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733856000 00000100:00100000:3.0:1789127362.440836:0:12098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 68 00000100:00100000:3.0:1789127362.440846:0:12098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae97a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+54:10641:x1876035733856000:12345-192.168.206.40@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789127362.440873:0:12098:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789127362.440979:0:12098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae97a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+54:10641:x1876035733856000:12345-192.168.206.40@tcp:53:lhsmtool_posix.0 Request processed in 135us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127362.440987:0:12098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 68 00000100:00100000:1.0:1789127362.456379:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127362.456609:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733856128 00000100:00100000:2.0:1789127362.456618:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733856128 00000100:00100000:2.0:1789127362.456676:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 69 00000100:00100000:2.0:1789127362.456686:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7af5cda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+54:10641:x1876035733856128:12345-192.168.206.40@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789127362.456754:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032dc00/0xeeacf7c024300958 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127362.456779:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032dc00/0xeeacf7c024300958 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127362.456809:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032dc00/0xeeacf7c024300958 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127362.456869:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c02430095f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127362.456877:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c02430095f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127362.456885:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c02430095f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127362.456926:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c800/0xeeacf7c024300966 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127362.456934:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c800/0xeeacf7c024300966 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127362.456941:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c800/0xeeacf7c024300966 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789127362.456974:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1789127362.456978:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789127362.456990:0:5832:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c800/0xeeacf7c024300966 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127362.457001:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032dc00/0xeeacf7c024300958 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127362.457007:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032dc00/0xeeacf7c024300958 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127362.457014:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032dc00/0xeeacf7c024300958 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127362.457021:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df79032dc00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:2.0:1789127362.457025:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032dc00/0xeeacf7c024300958 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127362.457032:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032dc00/0xeeacf7c024300958 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127362.457043:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8df79f06c900) 00010000:00010000:2.0:1789127362.457052:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789127362.457057:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032dc00/0xeeacf7c024300958 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127362.457063:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032dc00/0xeeacf7c024300958 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127362.457134:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c02430095f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127362.457140:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c02430095f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127362.457145:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c02430095f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127362.457150:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df79032c200 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:2.0:1789127362.457153:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c02430095f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127362.457158:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c02430095f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127362.457166:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff8df7906f6900) 00010000:00010000:2.0:1789127362.457168:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789127362.457171:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c02430095f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127362.457175:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c02430095f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127362.457189:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c800/0xeeacf7c024300966 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127362.457201:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c800/0xeeacf7c024300966 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127362.457206:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c800/0xeeacf7c024300966 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127362.457211:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df79032c800 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:2.0:1789127362.457214:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c800/0xeeacf7c024300966 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127362.457220:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c800/0xeeacf7c024300966 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127362.457228:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df7906f6600) 00010000:00010000:2.0:1789127362.457230:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789127362.457233:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c800/0xeeacf7c024300966 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127362.457238:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c800/0xeeacf7c024300966 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127362.457307:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7af5cda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+54:10641:x1876035733856128:12345-192.168.206.40@tcp:34:lhsmtool_posix.0 Request processed in 621us (934us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127362.457315:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 69 00000100:00100000:0.0:1789127362.471188:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127362.471263:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733856384 00000100:00100000:1.0:1789127362.471272:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733856384 00000100:00100000:1.0:1789127362.471331:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 70 00000100:00100000:1.0:1789127362.471340:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df787b8cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+54:10641:x1876035733856384:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789127362.471361:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127362.471382:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c02430096d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7b97 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127362.471472:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c024300974 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127362.471486:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c024300974 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127362.471496:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c024300974 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789127362.471506:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1789127362.471596:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c024300974 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127362.471604:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c024300974 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127362.471610:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c024300974 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127362.471634:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd96600 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:1.0:1789127362.471638:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c024300974 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127362.471646:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c024300974 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127362.471659:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df7906f6600) 00010000:00010000:1.0:1789127362.471662:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789127362.471667:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c024300974 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127362.471672:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c024300974 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127362.471712:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c02430096d lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b97 expref: 56 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127362.471722:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8df79f06c900) 00010000:00010000:1.0:1789127362.471725:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789127362.471728:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c02430096d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b97 expref: 56 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127362.471737:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7bbd97800, rc 0) 00000100:00100000:1.0:1789127362.471842:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df787b8cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+55:10641:x1876035733856384:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 Request processed in 502us (663us total) trans 4294967352 rc 301/301 00000100:00100000:1.0:1789127362.471850:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 70 00000100:00100000:2.0:1789127362.475243:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127362.478974:0:12098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733856512 00000100:00100000:0.0:1789127362.478993:0:12098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733856512 00000100:00100000:0.0:1789127362.479100:0:12098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 71 00000100:00100000:0.0:1789127362.479111:0:12098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae978780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+55:10641:x1876035733856512:12345-192.168.206.40@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789127362.479143:0:12098:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789127362.479241:0:12098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae978780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+55:10641:x1876035733856512:12345-192.168.206.40@tcp:53:lhsmtool_posix.0 Request processed in 132us (4004us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127362.479249:0:12098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 71 00000100:00100000:1.0:1789127362.496883:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127362.496930:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733856768 00000100:00100000:1.0:1789127362.496940:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733856768 00000100:00100000:1.0:1789127362.496989:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 72 00000100:00100000:1.0:1789127362.496998:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7af5cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+55:10641:x1876035733856768:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789127362.497017:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127362.497020:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789127362.497045:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c02430092e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b89 expref: 55 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127362.497064:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8df7906f6b00) 00010000:00010000:1.0:1789127362.497070:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789127362.497084:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c024300982 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7b9e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789127362.497471:0:5831:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:1.0:1789127362.497667:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c024300989 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127362.497680:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c024300989 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127362.497690:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c024300989 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127362.497741:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c024300982 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b9e expref: 57 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127362.497756:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c024300989 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b9e expref: 56 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127362.497819:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8df782d66e00) 00010000:00010000:1.0:1789127362.497823:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789127362.497825:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7bbd96600, rc 0) 00000100:00100000:1.0:1789127362.497891:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7af5cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+56:10641:x1876035733856768:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 Request processed in 893us (1017us total) trans 4294967353 rc 0/0 00000100:00100000:1.0:1789127362.497899:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 72 00000100:00100000:0.0:1789127362.518604:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127362.518867:0:10285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733857024 00000100:00100000:1.0:1789127362.518876:0:10285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733857024 00000100:00100000:1.0:1789127362.519067:0:10285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 73 00000100:00100000:1.0:1789127362.519077:0:10285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bb96f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+56:10641:x1876035733857024:12345-192.168.206.40@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789127362.519127:0:10285:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789127362.519151:0:10285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c024300989 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b9e expref: 56 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127362.519165:0:10285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8df782d66e00) 00010000:00010000:1.0:1789127362.519174:0:10285:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789127362.519196:0:10285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c024300997 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127362.519209:0:10285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c024300997 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127362.519218:0:10285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c024300997 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127362.519231:0:10285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96200/0xeeacf7c02430099e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x329c7829 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127362.519255:0:10285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96200/0xeeacf7c02430099e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x329c7829 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127362.519264:0:10285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96200/0xeeacf7c02430099e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x329c7829 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127362.519331:0:10285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c024300997 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127362.519339:0:10285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c024300997 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127362.519345:0:10285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c024300997 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127362.519352:0:10285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd97800 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:1.0:1789127362.519356:0:10285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c024300997 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127362.519363:0:10285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c024300997 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127362.519372:0:10285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8df7906f6b00) 00010000:00010000:1.0:1789127362.519375:0:10285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789127362.519379:0:10285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c024300997 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127362.519385:0:10285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c024300997 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127362.519393:0:10285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96200/0xeeacf7c02430099e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x329c7829 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127362.519406:0:10285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96200/0xeeacf7c02430099e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x329c7829 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127362.519412:0:10285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96200/0xeeacf7c02430099e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x329c7829 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127362.519417:0:10285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd96200 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:1.0:1789127362.519420:0:10285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96200/0xeeacf7c02430099e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x329c7829 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127362.519427:0:10285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96200/0xeeacf7c02430099e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x329c7829 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127362.519435:0:10285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x329c7829 (ffff8df782d66600) 00010000:00010000:1.0:1789127362.519438:0:10285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789127362.519441:0:10285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96200/0xeeacf7c02430099e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x329c7829 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127362.519446:0:10285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96200/0xeeacf7c02430099e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x329c7829 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127362.519522:0:10285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bb96f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+55:10641:x1876035733857024:12345-192.168.206.40@tcp:36:lhsmtool_posix.0 Request processed in 446us (929us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789127362.519530:0:10285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 73 00000100:00100000:2.0:1789127362.525261:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127362.525771:0:12098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733857152 00000100:00100000:0.0:1789127362.525781:0:12098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733857152 00000100:00100000:0.0:1789127362.525858:0:12098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 74 00000100:00100000:0.0:1789127362.525867:0:12098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeae6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+55:10641:x1876035733857152:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789127362.525886:0:12098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127362.525908:0:12098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728000/0xeeacf7c0243009a5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7ba5 expref: -99 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127362.525942:0:12098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728a00/0xeeacf7c0243009ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127362.525955:0:12098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728a00/0xeeacf7c0243009ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127362.525967:0:12098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728a00/0xeeacf7c0243009ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127362.526058:0:12098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728000/0xeeacf7c0243009a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7ba5 expref: 57 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127362.526087:0:12098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728a00/0xeeacf7c0243009ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7ba5 expref: 56 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127362.526095:0:12098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8df782a68b00) 00010000:00010000:0.0:1789127362.526098:0:12098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789127362.526101:0:12098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7ae728a00, rc 0) 00000100:00100000:0.0:1789127362.526156:0:12098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeae6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+56:10641:x1876035733857152:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 Request processed in 289us (905us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127362.526163:0:12098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 74 00000100:00100000:1.0:1789127362.534288:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127362.534325:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733857408 00000100:00100000:1.0:1789127362.534333:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733857408 00000100:00100000:1.0:1789127362.534381:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 75 00000100:00100000:1.0:1789127362.534390:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7af5cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+56:10641:x1876035733857408:12345-192.168.206.40@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789127362.534477:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96800/0xeeacf7c0243009b3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127362.534510:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96800/0xeeacf7c0243009b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127362.534523:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96800/0xeeacf7c0243009b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789127362.534819:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:1.0:1789127362.534830:0:5830:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 308691040756ns, next at 309691038086ns, rc = 0 00000004:00010000:1.0:1789127362.534916:0:5830:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000fc714629 reply state 000000007554d5cd transno 4294967354 ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96800/0xeeacf7c0243009b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127362.534925:0:5830:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789127362.535024:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7af5cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+58:10641:x1876035733857408:12345-192.168.206.40@tcp:36:lhsmtool_posix.0 Request processed in 634us (743us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1789127362.535032:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 75 00000100:00100000:1.0:1789127362.553376:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00010000:00010000:3.0:1789127362.553702:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96800/0xeeacf7c0243009b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127362.553890:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96800/0xeeacf7c0243009b3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127362.553897:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96800/0xeeacf7c0243009b3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127362.553903:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd96800 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:3.0:1789127362.553907:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96800/0xeeacf7c0243009b3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127362.553915:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96800/0xeeacf7c0243009b3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127362.553931:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8df782a68b00) 00010000:00010000:3.0:1789127362.553934:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789127362.553938:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96800/0xeeacf7c0243009b3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127362.553961:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96800/0xeeacf7c0243009b3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127362.554256:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733857536 00000100:00100000:0.0:1789127362.554266:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733857536 00000100:00100000:0.0:1789127362.554716:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 76 00000100:00100000:0.0:1789127362.554727:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7af5ce940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+57:10641:x1876035733857536:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789127362.555326:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127362.555345:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728000/0xeeacf7c0243009ba lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7bac expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127362.555401:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728000/0xeeacf7c0243009ba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7bac expref: 58 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127362.555414:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728000/0xeeacf7c0243009ba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7bac expref: 58 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127362.555433:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8df782a68b00) 00010000:00010000:0.0:1789127362.555435:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789127362.555447:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7ae728000, rc 0) 00000100:00100000:0.0:1789127362.555507:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7af5ce940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+58:10641:x1876035733857536:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 Request processed in 782us (2136us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127362.555515:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 76 00000100:00100000:2.0:1789127362.560778:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127362.560853:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733857664 00000100:00100000:3.0:1789127362.560863:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733857664 00000100:00100000:3.0:1789127362.560907:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 24 00000100:00100000:3.0:1789127362.560915:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df787b8ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2345:x1876035733857664:12345-192.168.206.40@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1789127362.560944:0:6686:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 28762f98-a240-4662-a754-e28bbeb6cb4b@192.168.206.40@tcp t0 exp 0000000000000000 cur 308 last 0 00000020:00000080:3.0:1789127362.560970:0:6686:0:(genops.c:1385:class_connect()) connect: client 28762f98-a240-4662-a754-e28bbeb6cb4b, cookie 0xeeacf7c0243009c1 00002000:00100000:3.0:1789127362.560981:0:6686:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 28762f98-a240-4662-a754-e28bbeb6cb4b/ffff8df78efd3800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113987 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789127362.561002:0:6686:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789127362.561185:0:6686:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789127362.561212:0:6686:0:(import.c:65:import_set_state_nolock()) ffff8df78efd1000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789127362.561842:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df787b8ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+6:2345:x1876035733857664:12345-192.168.206.40@tcp:8:lhsmtool_posix.0 Request processed in 869us (1025us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127362.561852:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 24 00000100:00100000:3.0:1789127362.565134:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127362.565181:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733857792 00000100:00100000:0.0:1789127362.565190:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733857792 00000100:00080000:3.0:1789127362.565239:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789127362.565251:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 25 00000100:00100000:0.0:1789127362.565261:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeb15680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+6:0:x1876035733857792:12345-192.168.206.40@tcp:2:lhsmtool_posix.0 00000001:00080000:2.0:1789127362.586500:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967337 is committed 00000001:00080000:2.0:1789127362.586527:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:2.0:1789127362.586540:0:5852:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000100:00100000:2.0:1789127362.586686:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789127362.586784:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae058b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1876035752758784:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789127362.586879:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127362.586968:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752758784 00000100:00100000:3.0:1789127362.586975:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752758784 00000100:00100000:3.0:1789127362.587026:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789127362.587036:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79a2c5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1876035752758784:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789127362.587263:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79a2c5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3300:x1876035752758784:12345-0@lo:2:osp-syn-1-0.0 Request processed in 229us (384us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1789127362.587271:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1789127362.587301:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1789127362.588478:0:5852:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:2.0:1789127362.588507:0:5852:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8df7b46be540 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:2.0:1789127362.588511:0:5852:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8df78eed7e00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8df7b46beb40 00000020:00080000:2.0:1789127362.588514:0:5852:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8df78eed7900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8df7ae970400 00000020:00080000:0.0:1789127362.588576:0:5863:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000004:00080000:2.0:1789127362.588633:0:3300:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8df7ae058b40/2, rc 0, transno 4294967302 00000100:00100000:2.0:1789127362.588640:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae058b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1876035752758784:0@lo:2:osp-syn-1-0.0 00000020:00080000:0.0:1789127362.588667:0:5863:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:1.0:1789127362.589877:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7af5cd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752758912:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789127362.589939:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127362.589994:0:8063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752758912 00000100:00100000:2.0:1789127362.590000:0:8063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752758912 00000100:00100000:2.0:1789127362.590067:0:8063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789127362.590076:0:8063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7af5cc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3302:x1876035752758912:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1789127362.590100:0:8063:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:2.0:1789127362.590129:0:8063:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6aa3eabf, atime: 0x6aa3eabf, ctime: 0x6aa3eabf, blocks: 0x1 00010000:00010000:2.0:1789127362.590137:0:8063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007cc680f8/0xeeacf7c0243009c8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127362.590154:0:8063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=308s v=(0 0) 00010000:00010000:2.0:1789127362.590158:0:8063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127362.590165:0:8063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007cc680f8/0xeeacf7c0243009c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127362.590181:0:8063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007cc680f8/0xeeacf7c0243009c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127362.590202:0:8063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007cc680f8/0xeeacf7c0243009c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127362.590211:0:8063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007cc680f8/0xeeacf7c0243009c8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127362.590252:0:8063:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789127362.590277:0:8511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789127362.590283:0:8511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007cc680f8/0xeeacf7c0243009c8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127362.590292:0:8511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df79032dc00 already unused, calling callback (ffffffffc17a4550) 00010000:00010000:3.0:1789127362.590296:0:8511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007cc680f8/0xeeacf7c0243009c8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127362.590304:0:8511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007cc680f8/0xeeacf7c0243009c8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127362.590320:0:8511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007cc680f8/0xeeacf7c0243009c8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127362.590327:0:8511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007cc680f8/0xeeacf7c0243009c8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127362.590343:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127362.590345:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127362.590347:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789127362.590500:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789127362.590905:0:8063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7af5cc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3302:x1876035752758912:12345-0@lo:6:osp-syn-0-0.0 Request processed in 829us (964us total) trans 4294967301 rc 0/0 00000004:00080000:1.0:1789127362.590953:0:3302:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8df7af5cd680/2, rc 0, transno 4294967301 00000100:00100000:1.0:1789127362.590960:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7af5cd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752758912:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789127362.590991:0:8063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789127362.595960:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeb15680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+7:0:x1876035733857792:12345-192.168.206.40@tcp:2:lhsmtool_posix.0 Request processed in 30691us (30826us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1789127362.595974:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 25 00000001:00080000:3.0:1789127362.596012:0:7646:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00100000:3.0:1789127362.596024:0:7646:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 28762f98-a240-4662-a754-e28bbeb6cb4b 00000100:00100000:2.0:1789127362.598148:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127362.598218:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733858048 00000100:00100000:1.0:1789127362.598227:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733858048 00000100:00100000:1.0:1789127362.598280:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 19 00000100:00100000:1.0:1789127362.598289:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae958f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+12:10641:x1876035733858048:12345-192.168.206.40@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789127362.598669:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae958f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+13:10641:x1876035733858048:12345-192.168.206.40@tcp:35:lhsmtool_posix.0 Request processed in 378us (527us total) trans 4294967355 rc 0/0 00000100:00100000:1.0:1789127362.598682:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 19 00000100:00100000:2.0:1789127362.600680:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127362.600929:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733858304 00000100:00100000:1.0:1789127362.600937:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733858304 00000100:00100000:1.0:1789127362.600993:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 77 00000100:00100000:1.0:1789127362.601003:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae91ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+13:10641:x1876035733858304:12345-192.168.206.40@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789127362.601107:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae91ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+13:10641:x1876035733858304:12345-192.168.206.40@tcp:57:lhsmtool_posix.0 Request processed in 105us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127362.601115:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 77 00000100:00100000:3.0:1789127362.607442:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127362.607697:0:10285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733858432 00000100:00100000:1.0:1789127362.607705:0:10285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733858432 00000100:00100000:1.0:1789127362.607908:0:10285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 78 00000100:00100000:1.0:1789127362.607920:0:10285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeb14780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+13:10641:x1876035733858432:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789127362.607941:0:10285:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127362.607961:0:10285:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96200/0xeeacf7c0243009cf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7bb3 expref: -99 pid: 10285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127362.608046:0:10285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c0243009d6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127362.608060:0:10285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c0243009d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127362.608070:0:10285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c0243009d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789127362.608110:0:10285:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789127362.608126:0:10285:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c0243009d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127362.608149:0:10285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96200/0xeeacf7c0243009cf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7bb3 expref: 15 pid: 10285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127362.608164:0:10285:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c0243009d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7bb3 expref: 14 pid: 10285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127362.608172:0:10285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8df782a68b00) 00010000:00010000:1.0:1789127362.608174:0:10285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789127362.608178:0:10285:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7bbd97800, rc 0) 00000100:00100000:1.0:1789127362.608223:0:10285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeb14780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+14:10641:x1876035733858432:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 Request processed in 306us (801us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127362.608230:0:10285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 78 00000100:00100000:2.0:1789127362.611343:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127362.611498:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733858560 00000100:00100000:3.0:1789127362.611515:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733858560 00000100:00100000:3.0:1789127362.611599:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 28 00000100:00100000:3.0:1789127362.611609:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae2fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+5:2346:x1876035733858560:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789127362.611624:0:6686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127362.611648:0:6686:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000466c8d8e/0xeeacf7c0243009dd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7bba expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789127362.611673:0:6686:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa3eac1, blocks: 0x1 00010000:00010000:3.0:1789127362.611690:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=308s v=(0 0) 00010000:00010000:3.0:1789127362.611695:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127362.611705:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000466c8d8e/0xeeacf7c0243009dd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7bba expref: 6 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127362.611725:0:6686:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000466c8d8e/0xeeacf7c0243009dd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7bba expref: 6 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127362.611738:0:6686:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df798df1c00, rc 0) 00000100:00100000:3.0:1789127362.611839:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae2fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+6:2346:x1876035733858560:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 Request processed in 231us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127362.611846:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 28 00000100:00100000:2.0:1789127362.617017:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127362.617115:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733858816 00000100:00100000:0.0:1789127362.617125:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733858816 00000100:00100000:0.0:1789127362.617179:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 79 00000100:00100000:0.0:1789127362.617189:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae2f92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+14:10641:x1876035733858816:12345-192.168.206.40@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789127362.617306:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae2f92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+14:10641:x1876035733858816:12345-192.168.206.40@tcp:57:lhsmtool_posix.0 Request processed in 117us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127362.617314:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 79 00000100:00100000:3.0:1789127362.620076:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127362.620229:0:8063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733858944 00000100:00100000:2.0:1789127362.620239:0:8063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733858944 00000100:00100000:2.0:1789127362.620305:0:8063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 29 00000100:00100000:2.0:1789127362.620314:0:8063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeb16580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+6:10641:x1876035733858944:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789127362.620331:0:8063:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127362.620348:0:8063:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a3e840f8/0xeeacf7c0243009e4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7bc1 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127362.620378:0:8063:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000466c8d8e/0xeeacf7c0243009dd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7bba expref: 7 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127362.620404:0:8063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127362.620409:0:8063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127362.620416:0:8063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a3e840f8/0xeeacf7c0243009e4 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7bc1 expref: 7 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127362.620447:0:8063:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000466c8d8e/0xeeacf7c0243009dd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7bba expref: 7 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127362.620460:0:8063:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000466c8d8e/0xeeacf7c0243009dd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7bba expref: 7 pid: 6686 timeout: 408 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127362.620474:0:8063:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae2f9e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8063:1876035752759040:192.168.206.40@tcp:104: 00000100:00100000:2.0:1789127362.620561:0:8063:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7aeaaf300 going to sleep for 11 seconds 00000100:00100000:2.0:1789127362.623961:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127362.623965:0:8063:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae2f9e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8063:1876035752759040:192.168.206.40@tcp:104: 00010000:00010000:0.0:1789127362.623998:0:8063:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a3e840f8/0xeeacf7c0243009e4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7bc1 expref: 7 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127362.624018:0:8063:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df79032ca00, rc 0) 00000100:00100000:0.0:1789127362.624078:0:8063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeb16580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+7:10641:x1876035733858944:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 Request processed in 3764us (4010us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127362.624087:0:8063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 29 00000100:00100000:3.0:1789127362.624597:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733859072 00000100:00100000:3.0:1789127362.624604:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733859072 00010000:00010000:3.0:1789127362.624641:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000466c8d8e/0xeeacf7c0243009dd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7bba expref: 7 pid: 6686 timeout: 408 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127362.624676:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 47 00000100:00100000:3.0:1789127362.624698:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae2f9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+7:2349:x1876035733859072:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789127362.624720:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127362.624750:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000466c8d8e/0xeeacf7c0243009dd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7bba expref: 7 pid: 6686 timeout: 408 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127362.624773:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000466c8d8e/0xeeacf7c0243009dd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7bba expref: 7 pid: 6686 timeout: 408 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127362.624826:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000466c8d8e/0xeeacf7c0243009dd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7bba expref: 7 pid: 6686 timeout: 408 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127362.624840:0:5815:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127362.624844:0:5815:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127362.624852:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a3e840f8/0xeeacf7c0243009e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7bc1 expref: 6 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127362.624862:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a3e840f8/0xeeacf7c0243009e4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7bc1 expref: 6 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127362.624893:0:5815:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a3e840f8/0xeeacf7c0243009e4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7bc1 expref: 6 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127362.624908:0:5815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7aeb17840 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5815:1876035752759168:192.168.206.40@tcp:105: 00000100:00100000:3.0:1789127362.624977:0:5815:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df785497b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789127362.630218:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127362.630370:0:5815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7aeb17840 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5815:1876035752759168:192.168.206.40@tcp:105: 00010000:00010000:3.0:1789127362.630408:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127362.630470:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae2f9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+6:2349:x1876035733859072:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 5772us (6517us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127362.630481:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 47 00000100:00100000:1.0:1789127362.630658:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733859200 00000100:00100000:1.0:1789127362.630665:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733859200 00002000:00100000:1.0:1789127362.630719:0:6694:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8df7ae2f8000 x1876035733859200/t0(0) o4->28762f98-a240-4662-a754-e28bbeb6cb4b@192.168.206.40@tcp:98/0 lens 504/0 e 0 to 0 dl 1789127373 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789127362.630728:0:6694:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff8df7ae2f8000 with x1876035733859200 ext(0->8) 00002000:00010000:1.0:1789127362.630737:0:6694:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df7ae2f8000 00000100:00100000:1.0:1789127362.630776:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 0 00000100:00100000:1.0:1789127362.630784:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae2f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+6:2349:x1876035733859200:12345-192.168.206.40@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789127362.631690:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae2f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+8:2349:x1876035733859200:12345-192.168.206.40@tcp:4:lhsmtool_posix.0 Request processed in 902us (1477us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1789127362.631704:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 0 00002000:00100000:1.0:1789127362.631712:0:6694:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8df7ae2f8000 x1876035733859200/t4294967303(0) o4->28762f98-a240-4662-a754-e28bbeb6cb4b@192.168.206.40@tcp:98/0 lens 504/448 e 0 to 0 dl 1789127373 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789127362.631721:0:6694:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff8df7ae2f8000 with x1876035733859200 ext(0->8) 00002000:00010000:1.0:1789127362.631725:0:6694:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df7ae2f8000 00000100:00100000:2.0:1789127362.636135:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127362.636223:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733859328 00000100:00100000:1.0:1789127362.636232:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733859328 00000100:00100000:1.0:1789127362.636289:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 80 00000100:00100000:1.0:1789127362.636298:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae2f83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+14:10641:x1876035733859328:12345-192.168.206.40@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1789127362.636419:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae2f83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+14:10641:x1876035733859328:12345-192.168.206.40@tcp:44:lhsmtool_posix.0 Request processed in 122us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127362.636426:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 80 00000100:00100000:0.0:1789127362.638540:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127362.638634:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733859456 00000100:00100000:3.0:1789127362.638642:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733859456 00000100:00100000:3.0:1789127362.638693:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 30 00000100:00100000:3.0:1789127362.638712:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bb96cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+8:2346:x1876035733859456:12345-192.168.206.40@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1789127362.677535:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bb96cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+8:2346:x1876035733859456:12345-192.168.206.40@tcp:16:lhsmtool_posix.0 Request processed in 38825us (38995us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127362.677548:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 30 00000001:00080000:2.0:1789127362.678110:0:7646:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:2.0:1789127362.678126:0:7646:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:1.0:1789127362.679918:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127362.680000:0:10285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733859712 00000100:00100000:2.0:1789127362.680010:0:10285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733859712 00000100:00100000:2.0:1789127362.680187:0:10285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 81 00000100:00100000:2.0:1789127362.680197:0:10285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7af5cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+14:10641:x1876035733859712:12345-192.168.206.40@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789127362.680249:0:10285:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789127362.680277:0:10285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c0243009d6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7bb3 expref: 14 pid: 10285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127362.680309:0:10285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8df782a68b00) 00010000:00010000:2.0:1789127362.680314:0:10285:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789127362.680349:0:10285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c0243009eb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127362.680363:0:10285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c0243009eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127362.680373:0:10285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c0243009eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789127362.680521:0:10285:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000002ff0a849 reply state 000000008a1b3644 transno 4294967356 ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c0243009eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127362.680531:0:10285:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789127362.680617:0:10285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7af5cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+15:10641:x1876035733859712:12345-192.168.206.40@tcp:36:lhsmtool_posix.0 Request processed in 422us (706us total) trans 4294967356 rc 0/0 00000100:00100000:2.0:1789127362.680625:0:10285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 81 00010000:00010000:3.0:1789127362.683825:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c0243009eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127362.683842:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c0243009eb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127362.683849:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c0243009eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127362.683855:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df79032c200 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:3.0:1789127362.683859:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c0243009eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127362.683866:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c0243009eb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127362.683883:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8df782a68b00) 00010000:00010000:3.0:1789127362.683886:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127362.683905:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c0243009eb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127362.683912:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c0243009eb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127362.684450:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127362.684971:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733859840 00000100:00100000:3.0:1789127362.684980:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733859840 00000100:00100000:3.0:1789127362.685040:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 31 00000100:00100000:3.0:1789127362.685050:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7af5cfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+6:2348:x1876035733859840:12345-192.168.206.40@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789127362.685298:0:6689:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1789127362.685302:0:6689:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1789127360 00002000:00010000:3.0:1789127362.685305:0:6689:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1789127359 00002000:00010000:3.0:1789127362.685307:0:6689:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1789127361 -> 1789127360 00002000:00010000:3.0:1789127362.685309:0:6689:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1789127362.685369:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7af5cfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+7:2348:x1876035733859840:12345-192.168.206.40@tcp:2:lhsmtool_posix.0 Request processed in 320us (922us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1789127362.685376:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 31 00000100:00100000:1.0:1789127362.694606:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127362.694824:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733860096 00000100:00100000:2.0:1789127362.694834:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733860096 00000100:00100000:2.0:1789127362.696883:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 82 00000100:00100000:2.0:1789127362.696907:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7af5ce580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+14:10641:x1876035733860096:12345-192.168.206.40@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1789127362.696978:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032dc00/0xeeacf7c0243009f2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127362.696994:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728a00/0xeeacf7c0243009ac lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7ba5 expref: 14 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127362.697025:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032dc00/0xeeacf7c0243009f2 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127362.697345:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728a00/0xeeacf7c0243009ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7ba5 expref: 14 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127362.697366:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728a00/0xeeacf7c0243009ac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7ba5 expref: 14 pid: 12098 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127362.697386:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae2fa940 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5831:1876035752759296:192.168.206.40@tcp:104: 00000100:00100000:2.0:1789127362.697488:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7aeaaf900 going to sleep for 11 seconds 00000100:00100000:0.0:1789127362.711271:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127362.711420:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae2fa940 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5831:1876035752759296:192.168.206.40@tcp:104: 00010000:00010000:2.0:1789127362.711447:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032dc00/0xeeacf7c0243009f2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127362.711556:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733860224 00000100:00100000:1.0:1789127362.711564:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733860224 00010000:00010000:1.0:1789127362.711601:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728a00/0xeeacf7c0243009ac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7ba5 expref: 15 pid: 12098 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127362.711637:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 48 00000100:00100000:1.0:1789127362.711646:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bb96ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+15:2348:x1876035733860224:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789127362.711659:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789127362.711665:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728a00/0xeeacf7c0243009ac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7ba5 expref: 15 pid: 12098 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127362.711695:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728a00/0xeeacf7c0243009ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7ba5 expref: 15 pid: 12098 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127362.711718:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728a00/0xeeacf7c0243009ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7ba5 expref: 15 pid: 12098 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127362.712125:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8df782a68b00) 00010000:00010000:1.0:1789127362.712132:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032dc00/0xeeacf7c0243009f2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127362.712143:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032dc00/0xeeacf7c0243009f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127362.712151:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032dc00/0xeeacf7c0243009f2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127362.718178:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789127362.718258:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bb96ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+14:2348:x1876035733860224:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 6607us (6989us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127362.718271:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 48 00010000:00010000:1.0:1789127362.723713:0:5831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032dc00/0xeeacf7c0243009f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127362.723729:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032dc00/0xeeacf7c0243009f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127362.724291:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032dc00/0xeeacf7c0243009f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127362.724299:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032dc00/0xeeacf7c0243009f2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127362.724307:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032dc00/0xeeacf7c0243009f2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127362.724331:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df79032dc00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:1.0:1789127362.724335:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032dc00/0xeeacf7c0243009f2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127362.724342:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032dc00/0xeeacf7c0243009f2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127362.724358:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8df782a68b00) 00010000:00010000:1.0:1789127362.724361:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1789127362.724365:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032dc00/0xeeacf7c0243009f2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127362.724371:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032dc00/0xeeacf7c0243009f2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127362.724519:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7af5ce580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+13:10641:x1876035733860096:12345-192.168.206.40@tcp:55:lhsmtool_posix.0 Request processed in 27618us (34732us total) trans 0 rc -22/-22 00000100:00100000:1.0:1789127362.724531:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 82 00000100:00100000:0.0:1789127362.731199:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127362.731287:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733860352 00000100:00100000:3.0:1789127362.731296:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733860352 00000100:00100000:3.0:1789127362.731352:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 32 00000100:00100000:3.0:1789127362.731362:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bb96f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+7:2347:x1876035733860352:12345-192.168.206.40@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789127362.731405:0:6686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000466c8d8e/0xeeacf7c0243009f9 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127362.731424:0:6686:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a3e840f8/0xeeacf7c0243009e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7bc1 expref: 7 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127362.731452:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127362.731457:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789127362.731461:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000466c8d8e/0xeeacf7c0243009f9 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127362.731495:0:6686:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a3e840f8/0xeeacf7c0243009e4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7bc1 expref: 7 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127362.731509:0:6686:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a3e840f8/0xeeacf7c0243009e4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7bc1 expref: 7 pid: 8063 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127362.731525:0:6686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7aeb17840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6686:1876035752759424:192.168.206.40@tcp:104: 00000100:00100000:3.0:1789127362.731605:0:6686:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7ae191600 going to sleep for 11 seconds 00000100:00100000:3.0:1789127362.745445:0:6686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7aeb17840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6686:1876035752759424:192.168.206.40@tcp:104: 00010000:00010000:3.0:1789127362.745473:0:6686:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000466c8d8e/0xeeacf7c0243009f9 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127362.753466:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127362.754086:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733860480 00000100:00100000:2.0:1789127362.754097:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733860480 00010000:00010000:2.0:1789127362.754141:0:8454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a3e840f8/0xeeacf7c0243009e4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7bc1 expref: 8 pid: 8063 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127362.754184:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 49 00000100:00100000:2.0:1789127362.754194:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7889c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+8:2348:x1876035733860480:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789127362.754223:0:8454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789127362.754245:0:8454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a3e840f8/0xeeacf7c0243009e4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7bc1 expref: 8 pid: 8063 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127362.754259:0:8454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a3e840f8/0xeeacf7c0243009e4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7bc1 expref: 8 pid: 8063 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127362.754283:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a3e840f8/0xeeacf7c0243009e4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7bc1 expref: 8 pid: 8063 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127362.754300:0:8454:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789127362.754304:0:8454:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789127362.754310:0:8454:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000466c8d8e/0xeeacf7c0243009f9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127362.754319:0:8454:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000466c8d8e/0xeeacf7c0243009f9 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127362.754351:0:8454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789127362.754406:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7889c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+7:2348:x1876035733860480:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 213us (950us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127362.754414:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 49 00010000:00010000:0.0:1789127362.754948:0:6686:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000466c8d8e/0xeeacf7c0243009f9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127362.754960:0:6686:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000466c8d8e/0xeeacf7c0243009f9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127362.754987:0:6686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000466c8d8e/0xeeacf7c0243009f9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127362.754996:0:6686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000466c8d8e/0xeeacf7c0243009f9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127362.755003:0:6686:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000466c8d8e/0xeeacf7c0243009f9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127362.755011:0:6686:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df798df1c00 already unused, calling callback (ffffffffc17a4550) 00010000:00010000:0.0:1789127362.755015:0:6686:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000466c8d8e/0xeeacf7c0243009f9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127362.755029:0:6686:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000466c8d8e/0xeeacf7c0243009f9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127362.755054:0:6686:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000466c8d8e/0xeeacf7c0243009f9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127362.755078:0:6686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000466c8d8e/0xeeacf7c0243009f9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127362.755145:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bb96f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+6:2347:x1876035733860352:12345-192.168.206.40@tcp:1:lhsmtool_posix.0 Request processed in 23784us (23954us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127362.755154:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 32 00000100:00100000:0.0:1789127362.776024:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127362.780991:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733860736 00000100:00100000:1.0:1789127362.781005:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733860736 00000100:00100000:1.0:1789127362.781077:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 83 00000100:00100000:1.0:1789127362.781087:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bb96fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+13:10641:x1876035733860736:12345-192.168.206.40@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789127362.781162:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024300a00 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127362.781180:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024300a00 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127362.781191:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024300a00 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127362.781385:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97a00/0xeeacf7c024300a07 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127362.781396:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728000/0xeeacf7c0243009ba lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7bac expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127362.781403:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97a00/0xeeacf7c024300a07 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127362.781433:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728000/0xeeacf7c0243009ba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7bac expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127362.781446:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728000/0xeeacf7c0243009ba lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7bac expref: 14 pid: 5832 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127362.781458:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7af5cf840 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5830:1876035752759552:192.168.206.40@tcp:104: 00000100:00100000:1.0:1789127362.781545:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7bbd93780 going to sleep for 11 seconds 00000100:00100000:1.0:1789127362.784844:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7af5cf840 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5830:1876035752759552:192.168.206.40@tcp:104: 00010000:00010000:1.0:1789127362.784882:0:5830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97a00/0xeeacf7c024300a07 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127362.785265:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127362.788993:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733860864 00000100:00100000:2.0:1789127362.789007:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733860864 00010000:00010000:2.0:1789127362.789127:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728000/0xeeacf7c0243009ba lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7bac expref: 15 pid: 5832 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127362.789253:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 50 00000100:00100000:2.0:1789127362.789264:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bb96cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+15:2348:x1876035733860864:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789127362.789280:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789127362.789288:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728000/0xeeacf7c0243009ba lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7bac expref: 15 pid: 5832 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127362.789302:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728000/0xeeacf7c0243009ba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7bac expref: 15 pid: 5832 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127362.789326:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728000/0xeeacf7c0243009ba lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7bac expref: 15 pid: 5832 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127362.789344:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8df782a68b00) 00010000:00010000:2.0:1789127362.789349:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97a00/0xeeacf7c024300a07 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127362.789358:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97a00/0xeeacf7c024300a07 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127362.789366:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97a00/0xeeacf7c024300a07 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127362.789400:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789127362.789486:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bb96cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+14:2348:x1876035733860864:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 223us (4222us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127362.789494:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 50 00010000:00010000:1.0:1789127362.789557:0:5830:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97a00/0xeeacf7c024300a07 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127362.789566:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97a00/0xeeacf7c024300a07 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789127362.789733:0:5830:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:1.0:1789127362.789995:0:5830:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:1.0:1789127362.790045:0:5830:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:1.0:1789127362.790212:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7af5cf840 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5830:1876035752759680:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789127362.790264:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127362.790346:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7bbd93f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789127362.792211:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752759680 00000100:00100000:3.0:1789127362.792225:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752759680 00000100:00100000:3.0:1789127362.792336:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789127362.792347:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7af5ccf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5830:x1876035752759680:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789127362.792465:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7af5ccf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5830:x1876035752759680:12345-0@lo:1000:mdt00_000.0 Request processed in 119us (2199us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127362.792472:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789127362.796679:0:5830:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967302 gen 2 00000004:00080000:3.0:1789127362.796691:0:5830:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8df7ae058b40, transno 4294967302 00000100:00100000:3.0:1789127362.796772:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7af5cf840 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5830:1876035752759680:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1789127362.797462:0:5830:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:3.0:1789127362.797548:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7aeb17840 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5830:1876035752759808:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789127362.797611:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127362.797646:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7ae1919c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789127362.797824:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752759808 00000100:00100000:0.0:1789127362.797831:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752759808 00000100:00100000:0.0:1789127362.797883:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789127362.797892:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeb14b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5830:x1876035752759808:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789127362.798314:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeb14b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5830:x1876035752759808:12345-0@lo:1000:mdt00_000.0 Request processed in 421us (701us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1789127362.798322:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789127362.803993:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7aeb17840 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5830:1876035752759808:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1789127362.804099:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97a00/0xeeacf7c024300a07 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127362.804110:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97a00/0xeeacf7c024300a07 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127362.804118:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97a00/0xeeacf7c024300a07 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127362.804124:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd97a00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:3.0:1789127362.804128:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97a00/0xeeacf7c024300a07 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127362.804137:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97a00/0xeeacf7c024300a07 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127362.804153:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8df782a68b00) 00010000:00010000:3.0:1789127362.804156:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789127362.804160:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97a00/0xeeacf7c024300a07 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127362.804166:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97a00/0xeeacf7c024300a07 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127362.804225:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032da00/0xeeacf7c024300935 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127362.804231:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032da00/0xeeacf7c024300935 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127362.804236:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032da00/0xeeacf7c024300935 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127362.804242:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df79032da00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:3.0:1789127362.804245:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032da00/0xeeacf7c024300935 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127362.804251:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032da00/0xeeacf7c024300935 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127362.804258:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df7906f6600) 00010000:00010000:3.0:1789127362.804261:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789127362.804264:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032da00/0xeeacf7c024300935 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127362.804270:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032da00/0xeeacf7c024300935 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127362.804289:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1000/0xeeacf7c024300a0e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127362.804301:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024300951 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b90 expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127362.804310:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1000/0xeeacf7c024300a0e lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127362.804346:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024300951 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b90 expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127362.804361:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024300951 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b90 expref: 17 pid: 5831 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127362.804375:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7aeb16d00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5830:1876035752759936:192.168.206.40@tcp:104: 00000100:00100000:3.0:1789127362.805058:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7ae1919c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789127362.815414:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127362.815548:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733860992 00000100:00100000:2.0:1789127362.815568:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733860992 00010000:00010000:2.0:1789127362.815606:0:8454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024300951 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b90 expref: 18 pid: 5831 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127362.815652:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 51 00000100:00100000:2.0:1789127362.815661:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bb96f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+18:2349:x1876035733860992:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789127362.815677:0:8454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789127362.815684:0:8454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024300951 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b90 expref: 18 pid: 5831 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127362.815697:0:8454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024300951 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b90 expref: 18 pid: 5831 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127362.815718:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df7906f6600) 00010000:00010000:2.0:1789127362.815723:0:8454:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1000/0xeeacf7c024300a0e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127362.815732:0:8454:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1000/0xeeacf7c024300a0e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127362.815740:0:8454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1000/0xeeacf7c024300a0e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127362.815768:0:8454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789127362.818302:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024300951 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7b90 expref: 18 pid: 5831 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127362.818326:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7aeb16d00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5830:1876035752759936:192.168.206.40@tcp:104: 00010000:00010000:3.0:1789127362.818350:0:5830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1000/0xeeacf7c024300a0e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127362.818360:0:5830:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1000/0xeeacf7c024300a0e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127362.818365:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1000/0xeeacf7c024300a0e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127362.818379:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1000/0xeeacf7c024300a0e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127362.818385:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1000/0xeeacf7c024300a0e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127362.818391:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1000/0xeeacf7c024300a0e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127362.818414:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df798df1000 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:3.0:1789127362.818418:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1000/0xeeacf7c024300a0e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127362.818426:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1000/0xeeacf7c024300a0e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127362.819103:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df7906f6600) 00010000:00010000:3.0:1789127362.819107:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127362.819111:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1000/0xeeacf7c024300a0e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127362.819118:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1000/0xeeacf7c024300a0e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127362.819131:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024300a00 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127362.819136:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024300a00 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127362.819142:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024300a00 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127362.819147:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd96a00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:3.0:1789127362.819150:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024300a00 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127362.819157:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024300a00 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127362.819178:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df7906f6600) 00010000:00010000:3.0:1789127362.819181:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789127362.819184:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024300a00 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127362.819189:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024300a00 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789127362.820181:0:12084:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789127362.820188:0:12084:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789127362.820218:0:12084:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1789127362.820225:0:12084:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789127362.821340:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bb96f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+17:2349:x1876035733860992:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 5671us (5925us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127362.821354:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 51 00000100:00100000:2.0:1789127362.829195:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bb96fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+16:10641:x1876035733860736:12345-192.168.206.40@tcp:57:lhsmtool_posix.0 Request processed in 48099us (53168us total) trans 4294967361 rc 0/0 00000100:00100000:2.0:1789127362.829228:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 83 00000020:00080000:2.0:1789127362.829237:0:5830:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1789127362.837151:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127362.837225:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733861248 00000100:00100000:3.0:1789127362.837234:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733861248 00000100:00100000:3.0:1789127362.837340:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 20 00000100:00100000:3.0:1789127362.837350:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bb96e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+16:10641:x1876035733861248:12345-192.168.206.40@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789127362.838030:0:5834:0:(mdd_object.c:4024:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789127362.838134:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967362 00010000:00010000:3.0:1789127362.838181:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1000/0xeeacf7c024300a15 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127362.838197:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1000/0xeeacf7c024300a15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127362.838209:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1000/0xeeacf7c024300a15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127362.838217:0:5834:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1000/0xeeacf7c024300a15 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127362.838223:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1000/0xeeacf7c024300a15 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127362.838229:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1000/0xeeacf7c024300a15 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127362.838263:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789127362.838341:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bb96e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+18:10641:x1876035733861248:12345-192.168.206.40@tcp:35:lhsmtool_posix.0 Request processed in 992us (1196us total) trans 4294967363 rc 0/0 00000100:00100000:3.0:1789127362.838350:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 20 00000020:00080000:3.0:1789127362.838355:0:5834:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789127362.839101:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789127362.839109:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1000/0xeeacf7c024300a15 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127362.839118:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df798df1000 already unused, calling callback (ffffffffc17a4550) 00010000:00010000:2.0:1789127362.839122:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1000/0xeeacf7c024300a15 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127362.839130:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1000/0xeeacf7c024300a15 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127362.839142:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8df79f06c400) 00010000:00010000:2.0:1789127362.839145:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789127362.839149:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1000/0xeeacf7c024300a15 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127362.839154:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1000/0xeeacf7c024300a15 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127362.839173:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127362.839175:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127362.839177:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127362.995020:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127364.019177:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127364.083107:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae2fa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876035752760192:0@lo:400:kworker.0 00000100:00100000:2.0:1789127364.083191:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127364.083244:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae2fb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1876035752760704:0@lo:400:kworker.0 00000100:00100000:2.0:1789127364.083271:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127364.083298:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789127364.083312:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae2f9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1876035752760320:0@lo:400:kworker.0 00000100:00100000:2.0:1789127364.083336:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127364.083396:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae2f9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3303:1876035752760064:0@lo:400:kworker.0 00000100:00100000:3.0:1789127364.083426:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127364.083463:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae2fa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1876035752760576:0@lo:400:kworker.0 00000100:00100000:3.0:1789127364.083483:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127364.083500:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789127364.083506:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae2f8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1876035752760448:0@lo:400:kworker.0 00000100:00100000:3.0:1789127364.083528:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127364.083560:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752760192 00000100:00100000:3.0:1789127364.083566:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752760192 00000100:00100000:3.0:1789127364.083607:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752760320 00000100:00100000:3.0:1789127364.083611:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752760320 00000100:00100000:3.0:1789127364.083638:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752760576 00000100:00100000:3.0:1789127364.083642:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752760576 00000100:00100000:3.0:1789127364.083659:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789127364.083668:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae2f8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876035752760192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127364.083723:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae2f8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876035752760192:12345-0@lo:400:kworker.0 Request processed in 56us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127364.083730:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789127364.083746:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789127364.083768:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae2fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876035752760320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127364.083833:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae2fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876035752760320:12345-0@lo:400:kworker.0 Request processed in 80us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127364.083840:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789127364.083853:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1789127364.083860:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeb170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876035752760576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127364.083891:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeb170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876035752760576:12345-0@lo:400:kworker.0 Request processed in 32us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127364.083896:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1789127364.083913:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752760704 00000100:00100000:3.0:1789127364.083916:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752760704 00000100:00100000:3.0:1789127364.083940:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752760448 00000100:00100000:3.0:1789127364.083943:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752760448 00000100:00100000:3.0:1789127364.083961:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789127364.083968:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae2fad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3300:x1876035752760704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127364.083998:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae2fad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3300:x1876035752760704:12345-0@lo:400:kworker.0 Request processed in 31us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127364.084004:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789127364.084015:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789127364.084021:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeb17c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3303:x1876035752760448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127364.084048:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeb17c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3303:x1876035752760448:12345-0@lo:400:kworker.0 Request processed in 27us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127364.084054:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:3.0:1789127364.084072:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789127364.084076:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789127364.084078:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789127364.084109:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae2f8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1876035752760448:0@lo:400:kworker.0 00000100:00100000:3.0:1789127364.084132:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae2fa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1876035752760576:0@lo:400:kworker.0 00000100:00100000:3.0:1789127364.084166:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae2f9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1876035752760320:0@lo:400:kworker.0 00000100:00100000:3.0:1789127364.084177:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae2fa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876035752760192:0@lo:400:kworker.0 00000100:00100000:3.0:1789127364.084186:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae2fb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1876035752760704:0@lo:400:kworker.0 00000100:00100000:2.0:1789127364.084614:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752760064 00000100:00100000:2.0:1789127364.084619:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752760064 00000100:00100000:2.0:1789127364.084657:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:2.0:1789127364.084664:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df790dc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:3303:x1876035752760064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127364.084719:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df790dc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:3303:x1876035752760064:12345-0@lo:400:kworker.0 Request processed in 56us (1292us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127364.084726:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:2.0:1789127364.084781:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae2f9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3303:1876035752760064:0@lo:400:kworker.0 00000100:00100000:0.0:1789127364.085262:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789127364.085275:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7aeb14f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1876035752760832:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789127364.085314:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127364.085435:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752760832 00000100:00100000:3.0:1789127364.085440:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752760832 00000100:00100000:3.0:1789127364.085487:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789127364.085495:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bb96d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1876035752760832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789127364.085522:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789127364.085567:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bb96d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1876035752760832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127364.085574:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789127364.085711:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7aeb14f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1876035752760832:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1789127364.192176:0:12450:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789127364.192184:0:12450:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789127364.192215:0:12450:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1789127364.192219:0:12450:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789127364.363125:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127364.363252:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733861504 00000100:00100000:3.0:1789127364.363261:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733861504 00000100:00100000:3.0:1789127364.363339:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 84 00000100:00100000:3.0:1789127364.363349:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bb96de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+18:10658:x1876035733861504:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:3.0:1789127364.363374:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127364.363394:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0e00/0xeeacf7c024300a1c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7bc8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127364.363656:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1200/0xeeacf7c024300a23 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127364.363671:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1200/0xeeacf7c024300a23 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127364.363692:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1200/0xeeacf7c024300a23 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789127364.363704:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:3.0:1789127364.363892:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0e00/0xeeacf7c024300a1c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7bc8 expref: 21 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127364.363911:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1200/0xeeacf7c024300a23 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7bc8 expref: 20 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127364.363920:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8df7906f6b00) 00010000:00010000:3.0:1789127364.363923:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789127364.363926:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df798df1200, rc 0) 00000100:00100000:3.0:1789127364.363976:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bb96de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+20:10658:x1876035733861504:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 630us (861us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1789127364.363984:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 84 00000100:00080000:1.0:1789127364.364169:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789127364.371799:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127364.371960:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733861632 00000100:00100000:3.0:1789127364.371969:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733861632 00000100:00100000:3.0:1789127364.372125:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 85 00000100:00100000:3.0:1789127364.372136:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bb96da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+20:10658:x1876035733861632:12345-192.168.206.40@tcp:34:lfs.0 00010000:00010000:3.0:1789127364.372207:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c024300a31 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127364.372224:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c024300a31 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127364.372235:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c024300a31 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127364.372262:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024300a38 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127364.372270:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024300a38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127364.372277:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024300a38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127364.372572:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1000/0xeeacf7c024300a3f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127364.372582:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1000/0xeeacf7c024300a3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127364.372590:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1000/0xeeacf7c024300a3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789127364.372626:0:5832:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1000/0xeeacf7c024300a3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127364.372638:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c024300a31 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127364.372644:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c024300a31 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127364.372650:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c024300a31 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127364.372656:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df798df1e00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:3.0:1789127364.372660:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c024300a31 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127364.372672:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c024300a31 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127364.372683:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8df7906f6b00) 00010000:00010000:3.0:1789127364.372686:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127364.372690:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c024300a31 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127364.372695:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c024300a31 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127364.372706:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024300a38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127364.372712:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024300a38 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127364.372718:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024300a38 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127364.372722:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df798df0200 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:3.0:1789127364.372725:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024300a38 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127364.372730:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024300a38 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127364.372736:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8df79f06c400) 00010000:00010000:3.0:1789127364.372738:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127364.372741:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024300a38 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127364.372767:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024300a38 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127364.372784:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1000/0xeeacf7c024300a3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127364.372822:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1000/0xeeacf7c024300a3f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127364.372827:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1000/0xeeacf7c024300a3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127364.372833:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df798df1000 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:3.0:1789127364.372836:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1000/0xeeacf7c024300a3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127364.372842:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1000/0xeeacf7c024300a3f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127364.372849:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df79f06cf00) 00010000:00010000:3.0:1789127364.372851:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127364.372854:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1000/0xeeacf7c024300a3f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127364.372859:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1000/0xeeacf7c024300a3f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127364.372930:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bb96da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+20:10658:x1876035733861632:12345-192.168.206.40@tcp:34:lfs.0 Request processed in 795us (1138us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127364.372939:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 85 00000100:00100000:1.0:1789127364.425814:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127364.426199:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733861888 00000100:00100000:1.0:1789127364.426209:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733861888 00000100:00100000:1.0:1789127364.426262:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 86 00000100:00100000:1.0:1789127364.426273:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7af5cd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+20:10661:x1876035733861888:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:1.0:1789127364.426292:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127364.426311:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96200/0xeeacf7c024300a46 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7bcf expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127364.426376:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c024300a4d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127364.426391:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c024300a4d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127364.426401:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c024300a4d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127364.426415:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c024300a54 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127364.426421:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c024300a54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127364.426427:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c024300a54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127364.427154:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024300a5b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127364.427166:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024300a5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127364.427174:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024300a5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789127364.427185:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1789127364.427269:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c024300a4d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127364.427276:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c024300a4d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127364.427281:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c024300a4d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127364.427287:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd96600 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:1.0:1789127364.427291:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c024300a4d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127364.427298:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c024300a4d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127364.427309:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8df7906f6b00) 00010000:00010000:1.0:1789127364.427312:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789127364.427316:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c024300a4d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127364.427332:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c024300a4d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127364.427344:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c024300a54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127364.427350:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c024300a54 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127364.427356:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c024300a54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127364.427362:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd97800 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:1.0:1789127364.427364:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c024300a54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127364.427370:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c024300a54 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127364.427377:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8df782d66600) 00010000:00010000:1.0:1789127364.427380:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789127364.427382:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c024300a54 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127364.427388:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c024300a54 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127364.427429:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96200/0xeeacf7c024300a46 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7bcf expref: 23 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127364.427443:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024300a5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7bcf expref: 22 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127364.427458:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df782d66b00) 00010000:00010000:1.0:1789127364.427461:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789127364.427463:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7bbd96000, rc 0) 00000100:00100000:1.0:1789127364.429659:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7af5cd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+22:10661:x1876035733861888:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 1262us (1743us total) trans 4294967365 rc 0/0 00000100:00100000:1.0:1789127364.429672:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 86 00000100:00100000:2.0:1789127364.445463:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127364.445707:0:10285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733862016 00000100:00100000:3.0:1789127364.445715:0:10285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733862016 00000100:00100000:3.0:1789127364.445821:0:10285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 87 00000100:00100000:3.0:1789127364.445831:0:10285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae2f9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+22:10661:x1876035733862016:12345-192.168.206.40@tcp:54:lfs.0 00010000:00010000:3.0:1789127364.445891:0:10285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1000/0xeeacf7c024300a69 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127364.445906:0:10285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1000/0xeeacf7c024300a69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127364.445916:0:10285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1000/0xeeacf7c024300a69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127364.445938:0:10285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1000/0xeeacf7c024300a69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127364.445944:0:10285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1000/0xeeacf7c024300a69 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127364.445951:0:10285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1000/0xeeacf7c024300a69 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127364.445957:0:10285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df798df1000 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:3.0:1789127364.445961:0:10285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1000/0xeeacf7c024300a69 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127364.445968:0:10285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1000/0xeeacf7c024300a69 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127364.445978:0:10285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df782d66b00) 00010000:00010000:3.0:1789127364.445981:0:10285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789127364.445995:0:10285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1000/0xeeacf7c024300a69 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127364.446002:0:10285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1000/0xeeacf7c024300a69 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127364.446067:0:10285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae2f9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+22:10661:x1876035733862016:12345-192.168.206.40@tcp:54:lfs.0 Request processed in 238us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127364.446075:0:10285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 87 00000100:00100000:3.0:1789127364.487926:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127364.488114:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733862272 00000100:00100000:1.0:1789127364.488123:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733862272 00000100:00100000:1.0:1789127364.488272:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 21 00000100:00100000:1.0:1789127364.488283:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79156b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+22:10661:x1876035733862272:12345-192.168.206.40@tcp:35:lfs.0 00000100:00100000:1.0:1789127364.488519:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79156b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+23:10661:x1876035733862272:12345-192.168.206.40@tcp:35:lfs.0 Request processed in 236us (600us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1789127364.488527:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 21 00000100:00100000:2.0:1789127364.571383:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127364.571507:0:12098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733862528 00000100:00100000:0.0:1789127364.571516:0:12098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733862528 00000100:00100000:0.0:1789127364.571574:0:12098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 88 00000100:00100000:0.0:1789127364.571585:0:12098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae2fbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+23:10182:x1876035733862528:12345-192.168.206.40@tcp:101:bash.0 00010000:00010000:0.0:1789127364.571608:0:12098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127364.571639:0:12098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729200/0xeeacf7c024300a70 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7bd6 expref: -99 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127364.572086:0:12098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c024300a77 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127364.572102:0:12098:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024300a5b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7bcf expref: 24 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127364.572112:0:12098:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c024300a77 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127364.572404:0:12098:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024300a5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7bcf expref: 24 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127364.572419:0:12098:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024300a5b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7bcf expref: 24 pid: 5830 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127364.572432:0:12098:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7af5cf840 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12098:1876035752760960:192.168.206.40@tcp:104: 00000100:00100000:1.0:1789127364.572538:0:12098:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7907023c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789127364.575349:0:12098:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7af5cf840 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12098:1876035752760960:192.168.206.40@tcp:104: 00010000:00010000:1.0:1789127364.575377:0:12098:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c024300a77 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127364.576250:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127364.576375:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733862656 00000100:00100000:0.0:1789127364.576382:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733862656 00010000:00010000:0.0:1789127364.576418:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024300a5b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7bcf expref: 25 pid: 5830 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127364.576473:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 52 00000100:00100000:0.0:1789127364.576484:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae2f8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+25:2348:x1876035733862656:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789127364.576497:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789127364.576504:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024300a5b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7bcf expref: 25 pid: 5830 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127364.576530:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024300a5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7bcf expref: 25 pid: 5830 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127364.576559:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024300a5b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7bcf expref: 25 pid: 5830 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127364.576574:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df782d66b00) 00010000:00010000:0.0:1789127364.576579:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c024300a77 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127364.576587:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c024300a77 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127364.576594:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c024300a77 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127364.576620:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789127364.576670:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae2f8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+24:2348:x1876035733862656:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 187us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127364.576678:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 52 00010000:00010000:1.0:1789127364.576853:0:12098:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c024300a77 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127364.576861:0:12098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c024300a77 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789127364.576878:0:12098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1789127364.577008:0:12098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729200/0xeeacf7c024300a70 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7bd6 expref: 25 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127364.577033:0:12098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c024300a77 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7bd6 expref: 24 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127364.577039:0:12098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df782d66b00) 00010000:00010000:1.0:1789127364.577042:0:12098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789127364.577044:0:12098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7ae729e00, rc 0) 00000100:00100000:1.0:1789127364.577083:0:12098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae2fbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+24:10182:x1876035733862528:12345-192.168.206.40@tcp:101:bash.0 Request processed in 5501us (5710us total) trans 4294967367 rc 0/0 00000100:00100000:1.0:1789127364.577090:0:12098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 88 00000100:00100000:2.0:1789127364.593284:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127364.593844:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733862912 00000100:00100000:1.0:1789127364.593854:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733862912 00000100:00100000:1.0:1789127364.593915:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 89 00000100:00100000:1.0:1789127364.593925:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae2fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+24:10182:x1876035733862912:12345-192.168.206.40@tcp:36:bash.0 00010000:00010000:1.0:1789127364.594188:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96200/0xeeacf7c024300a85 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127364.594206:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96200/0xeeacf7c024300a85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127364.594229:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96200/0xeeacf7c024300a85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789127364.594283:0:5831:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000004:00010000:1.0:1789127364.594311:0:5831:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000006b7fd9de reply state 00000000a4cb66ab transno 4294967369 ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96200/0xeeacf7c024300a85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127364.594321:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1789127364.594369:0:5831:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000100:00100000:1.0:1789127364.594627:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae2fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+28:10182:x1876035733862912:12345-192.168.206.40@tcp:36:bash.0 Request processed in 701us (1349us total) trans 4294967370 rc 0/0 00000100:00100000:1.0:1789127364.594635:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 89 00000020:00080000:1.0:1789127364.594640:0:5831:0:(tgt_main.c:785:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1789127364.597172:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00010000:00010000:2.0:1789127364.597273:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96200/0xeeacf7c024300a85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127364.597285:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96200/0xeeacf7c024300a85 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127364.597291:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96200/0xeeacf7c024300a85 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127364.597315:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd96200 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:2.0:1789127364.597321:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96200/0xeeacf7c024300a85 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127364.597328:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96200/0xeeacf7c024300a85 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127364.597343:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df782d66b00) 00010000:00010000:2.0:1789127364.597347:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789127364.597352:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96200/0xeeacf7c024300a85 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127364.597357:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96200/0xeeacf7c024300a85 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127364.597657:0:10285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733863040 00000100:00100000:0.0:1789127364.597666:0:10285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733863040 00000100:00100000:0.0:1789127364.597718:0:10285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 90 00000100:00100000:0.0:1789127364.597726:0:10285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeb17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+27:10182:x1876035733863040:12345-192.168.206.40@tcp:101:bash.0 00010000:00010000:0.0:1789127364.597746:0:10285:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127364.597771:0:10285:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c024300a8c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7bdd expref: -99 pid: 10285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127364.597872:0:10285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c024300a8c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7bdd expref: 28 pid: 10285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127364.597884:0:10285:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c024300a8c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7bdd expref: 28 pid: 10285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127364.597899:0:10285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df782d66b00) 00010000:00010000:0.0:1789127364.597902:0:10285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789127364.597904:0:10285:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7ae729c00, rc 0) 00000100:00100000:0.0:1789127364.597953:0:10285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeb17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+28:10182:x1876035733863040:12345-192.168.206.40@tcp:101:bash.0 Request processed in 228us (791us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127364.597959:0:10285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 90 00000100:00100000:0.0:1789127364.601446:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127364.601533:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733863168 00000100:00100000:3.0:1789127364.601541:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733863168 00000100:00100000:3.0:1789127364.601645:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 33 00000100:00100000:3.0:1789127364.601654:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bb96c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+6:10182:x1876035733863168:12345-192.168.206.40@tcp:101:bash.0 00010000:00010000:3.0:1789127364.601669:0:6689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127364.601686:0:6689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b830ec46/0xeeacf7c024300a93 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7be4 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789127364.601710:0:6689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aa3eac0, atime: 0x6aa3eabf, ctime: 0x6aa3eac0, blocks: 0xb 00010000:00010000:3.0:1789127364.601729:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=310s v=(0 0) 00010000:00010000:3.0:1789127364.601734:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127364.601742:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b830ec46/0xeeacf7c024300a93 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7be4 expref: 7 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127364.601771:0:6689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b830ec46/0xeeacf7c024300a93 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7be4 expref: 7 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127364.601848:0:6689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df798df0200, rc 0) 00000100:00100000:3.0:1789127364.601909:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bb96c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+7:10182:x1876035733863168:12345-192.168.206.40@tcp:101:bash.0 Request processed in 255us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127364.601918:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 33 00000100:00080000:1.0:1789127364.602206:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789127364.611948:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127364.612336:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733863296 00000100:00100000:1.0:1789127364.612345:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733863296 00002000:00010000:1.0:1789127364.612386:0:6692:0:(ofd_dev.c:2842:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:1.0:1789127364.612391:0:6692:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff8df7ae2fb840 with x1876035733863296 ext(0->18446744073709551615) 00002000:00010000:1.0:1789127364.612402:0:6692:0:(ofd_dev.c:2847:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df7ae2fb840. 00000100:00100000:1.0:1789127364.612469:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 1 00000100:00100000:1.0:1789127364.612479:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae2fb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+7:2347:x1876035733863296:12345-192.168.206.40@tcp:10:bash.0 00002000:00010000:1.0:1789127364.612720:0:6692:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1789127364.612723:0:6692:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1789127360 -> 1789127363 00002000:00010000:1.0:1789127364.612726:0:6692:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1789127359 -> 1789127359 00002000:00010000:1.0:1789127364.612728:0:6692:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1789127360 -> 1789127363 00002000:00010000:1.0:1789127364.612729:0:6692:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1789127364.612820:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae2fb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+8:2347:x1876035733863296:12345-192.168.206.40@tcp:10:bash.0 Request processed in 342us (880us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1789127364.612838:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 1 00002000:00010000:1.0:1789127364.612842:0:6692:0:(ofd_dev.c:2842:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:1.0:1789127364.612845:0:6692:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff8df7ae2fb840 with x1876035733863296 ext(0->18446744073709551615) 00002000:00010000:1.0:1789127364.612849:0:6692:0:(ofd_dev.c:2847:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df7ae2fb840. 00000100:00100000:1.0:1789127364.735785:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127364.735871:0:12098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733863424 00000100:00100000:0.0:1789127364.735881:0:12098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733863424 00000100:00100000:0.0:1789127364.735935:0:12098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 91 00000100:00100000:0.0:1789127364.735945:0:12098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7af5cf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+28:10675:x1876035733863424:12345-192.168.206.40@tcp:34:lfs.0 00010000:00010000:0.0:1789127364.736005:0:12098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728400/0xeeacf7c024300a9a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127364.736021:0:12098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728400/0xeeacf7c024300a9a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127364.736032:0:12098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728400/0xeeacf7c024300a9a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127364.736058:0:12098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729a00/0xeeacf7c024300aa1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127364.736079:0:12098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729a00/0xeeacf7c024300aa1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127364.736087:0:12098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729a00/0xeeacf7c024300aa1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127364.736378:0:12098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729800/0xeeacf7c024300aa8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127364.736387:0:12098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729800/0xeeacf7c024300aa8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127364.736394:0:12098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729800/0xeeacf7c024300aa8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789127364.736428:0:12098:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729800/0xeeacf7c024300aa8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127364.736438:0:12098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728400/0xeeacf7c024300a9a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127364.736444:0:12098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728400/0xeeacf7c024300a9a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127364.736451:0:12098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728400/0xeeacf7c024300a9a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127364.736457:0:12098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7ae728400 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:0.0:1789127364.736461:0:12098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728400/0xeeacf7c024300a9a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127364.736468:0:12098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728400/0xeeacf7c024300a9a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127364.736486:0:12098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8df7906f6b00) 00010000:00010000:0.0:1789127364.736489:0:12098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127364.736495:0:12098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728400/0xeeacf7c024300a9a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127364.736501:0:12098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728400/0xeeacf7c024300a9a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127364.736513:0:12098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729a00/0xeeacf7c024300aa1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127364.736519:0:12098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729a00/0xeeacf7c024300aa1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127364.736525:0:12098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729a00/0xeeacf7c024300aa1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127364.736530:0:12098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7ae729a00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:0.0:1789127364.736533:0:12098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729a00/0xeeacf7c024300aa1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127364.736538:0:12098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729a00/0xeeacf7c024300aa1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127364.736546:0:12098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8df782a68d00) 00010000:00010000:0.0:1789127364.736548:0:12098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127364.736551:0:12098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729a00/0xeeacf7c024300aa1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127364.736556:0:12098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729a00/0xeeacf7c024300aa1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127364.736581:0:12098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729800/0xeeacf7c024300aa8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127364.736586:0:12098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729800/0xeeacf7c024300aa8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127364.736591:0:12098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729800/0xeeacf7c024300aa8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127364.736596:0:12098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7ae729800 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:0.0:1789127364.736599:0:12098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729800/0xeeacf7c024300aa8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127364.736605:0:12098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729800/0xeeacf7c024300aa8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127364.736612:0:12098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df782d66b00) 00010000:00010000:0.0:1789127364.736615:0:12098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127364.736617:0:12098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729800/0xeeacf7c024300aa8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127364.736623:0:12098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729800/0xeeacf7c024300aa8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127364.736700:0:12098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7af5cf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+28:10675:x1876035733863424:12345-192.168.206.40@tcp:34:lfs.0 Request processed in 754us (922us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127364.736707:0:12098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 91 00000100:00100000:0.0:1789127364.788487:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127364.788655:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733863680 00000100:00100000:3.0:1789127364.788665:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733863680 00000100:00100000:3.0:1789127364.788723:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 92 00000100:00100000:3.0:1789127364.788741:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bb96c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+28:10678:x1876035733863680:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:3.0:1789127364.788768:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127364.788822:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1000/0xeeacf7c024300aaf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7beb expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127364.788894:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c024300ab6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127364.788907:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c024300ab6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127364.788918:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c024300ab6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127364.788932:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0e00/0xeeacf7c024300abd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127364.788940:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0e00/0xeeacf7c024300abd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127364.788945:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0e00/0xeeacf7c024300abd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127364.789286:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024300ac4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127364.789297:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024300ac4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127364.789304:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024300ac4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789127364.789314:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1789127364.789400:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c024300ab6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127364.789406:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c024300ab6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127364.789412:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c024300ab6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127364.789418:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df798df1e00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:3.0:1789127364.789422:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c024300ab6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127364.789429:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c024300ab6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127364.789455:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8df7906f6b00) 00010000:00010000:3.0:1789127364.789458:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127364.789463:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c024300ab6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127364.789479:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c024300ab6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127364.789492:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0e00/0xeeacf7c024300abd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127364.789498:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0e00/0xeeacf7c024300abd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127364.789503:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0e00/0xeeacf7c024300abd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127364.789508:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df798df0e00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:3.0:1789127364.789511:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0e00/0xeeacf7c024300abd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127364.789517:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0e00/0xeeacf7c024300abd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127364.789525:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8df79f06ce00) 00010000:00010000:3.0:1789127364.789528:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127364.789531:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0e00/0xeeacf7c024300abd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127364.789537:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0e00/0xeeacf7c024300abd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127364.789578:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1000/0xeeacf7c024300aaf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7beb expref: 31 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127364.789591:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024300ac4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7beb expref: 30 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127364.789605:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df782d66b00) 00010000:00010000:3.0:1789127364.789607:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789127364.789609:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df798df1c00, rc 0) 00000100:00100000:3.0:1789127364.789674:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bb96c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+30:10678:x1876035733863680:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 942us (1195us total) trans 4294967371 rc 0/0 00000100:00100000:3.0:1789127364.789682:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 92 00000100:00100000:2.0:1789127364.794300:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127364.794669:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733863808 00000100:00100000:1.0:1789127364.794678:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733863808 00000100:00100000:1.0:1789127364.794733:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 93 00000100:00100000:1.0:1789127364.794743:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae2fa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+30:10678:x1876035733863808:12345-192.168.206.40@tcp:54:lfs.0 00010000:00010000:1.0:1789127364.794841:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c024300ad2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127364.794858:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c024300a77 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7bd6 expref: 30 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127364.794868:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c024300ad2 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127364.794902:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c024300a77 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7bd6 expref: 30 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127364.794916:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c024300a77 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7bd6 expref: 30 pid: 12098 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127364.794929:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae958f00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5830:1876035752761088:192.168.206.40@tcp:104: 00000100:00100000:1.0:1789127364.795017:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7b46be3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789127364.798616:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae958f00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5830:1876035752761088:192.168.206.40@tcp:104: 00010000:00010000:2.0:1789127364.798647:0:5830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c024300ad2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127364.800637:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127364.800878:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733864064 00000100:00100000:3.0:1789127364.800886:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733864064 00000100:00100000:3.0:1789127364.800944:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 22 00000100:00100000:3.0:1789127364.800964:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae2f9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+31:5588:x1876035733864064:12345-192.168.206.40@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789127364.801279:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae2f9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+32:5588:x1876035733864064:12345-192.168.206.40@tcp:35:ldlm_bl.0 Request processed in 325us (648us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1789127364.801287:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 22 00000100:00100000:1.0:1789127364.804084:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127364.804254:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733864192 00000100:00100000:3.0:1789127364.804263:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733864192 00010000:00010000:3.0:1789127364.804304:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c024300a77 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7bd6 expref: 32 pid: 12098 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127364.804346:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 53 00000100:00100000:3.0:1789127364.804357:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae958f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+32:2348:x1876035733864192:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789127364.804372:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127364.804379:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c024300a77 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7bd6 expref: 32 pid: 12098 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127364.804392:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c024300a77 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7bd6 expref: 32 pid: 12098 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127364.804424:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c024300a77 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7bd6 expref: 32 pid: 12098 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127364.804446:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df782d66b00) 00010000:00010000:3.0:1789127364.804452:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c024300ad2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127364.804461:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c024300ad2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127364.804469:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c024300ad2 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127364.804501:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127364.804558:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae958f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+31:2348:x1876035733864192:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 203us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127364.804565:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 53 00010000:00010000:1.0:1789127364.805270:0:5830:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c024300ad2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127364.805281:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c024300ad2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127364.805309:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c024300ad2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127364.805316:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c024300ad2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127364.805323:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c024300ad2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127364.805329:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd96600 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:1.0:1789127364.805334:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c024300ad2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127364.805341:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c024300ad2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127364.805354:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df782d66b00) 00010000:00010000:1.0:1789127364.805356:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789127364.805360:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c024300ad2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127364.805366:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c024300ad2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127364.805425:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae2fa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+30:10678:x1876035733863808:12345-192.168.206.40@tcp:54:lfs.0 Request processed in 10682us (11133us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127364.805434:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 93 00000100:00100000:1.0:1789127364.808583:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127364.808640:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733864448 00000100:00100000:3.0:1789127364.808649:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733864448 00000100:00100000:3.0:1789127364.808702:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 23 00000100:00100000:3.0:1789127364.808710:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae058b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+30:10678:x1876035733864448:12345-192.168.206.40@tcp:35:lfs.0 00000100:00100000:3.0:1789127364.808964:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae058b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+31:10678:x1876035733864448:12345-192.168.206.40@tcp:35:lfs.0 Request processed in 242us (376us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1789127364.808972:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 23 00000100:00100000:0.0:1789127364.843060:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127364.843105:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127364.843217:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733864576 00000100:00100000:1.0:1789127364.843226:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733864576 00000100:00100000:1.0:1789127364.843281:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 319 00000100:00100000:1.0:1789127364.843291:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df790dc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d829a69b-d740-4e4c-8301-ef09c9d45165+13:2346:x1876035733864576:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:1.0:1789127364.843366:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df790dc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d829a69b-d740-4e4c-8301-ef09c9d45165+13:2346:x1876035733864576:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 76us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127364.843374:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 319 00000100:00100000:3.0:1789127364.843685:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127364.844018:0:8063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733864704 00000100:00100000:2.0:1789127364.844024:0:8063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733864704 00000100:00100000:2.0:1789127364.844084:0:8063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 70 00000100:00100000:2.0:1789127364.844092:0:8063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bb96e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+7:2346:x1876035733864704:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:2.0:1789127364.844134:0:8063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bb96e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+7:2346:x1876035733864704:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 43us (1028us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127364.844154:0:8063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 70 00000100:00080000:3.0:1789127364.844286:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789127364.844345:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733864832 00000100:00100000:1.0:1789127364.844350:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733864832 00000100:00100000:1.0:1789127364.844395:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 143 00000100:00100000:1.0:1789127364.844403:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeb14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81b0e267-d7e0-4043-b34e-eec2dc4c5a6b+5:2347:x1876035733864832:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:1.0:1789127364.844441:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeb14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81b0e267-d7e0-4043-b34e-eec2dc4c5a6b+5:2347:x1876035733864832:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 39us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127364.844448:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 143 00000100:00080000:3.0:1789127364.844584:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789127364.896045:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127364.896151:0:10285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733865088 00000100:00100000:0.0:1789127364.896161:0:10285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733865088 00000100:00100000:0.0:1789127364.896229:0:10285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 94 00000100:00100000:0.0:1789127364.896238:0:10285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae2fa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+31:10690:x1876035733865088:12345-192.168.206.40@tcp:101:cat.0 00010000:00010000:0.0:1789127364.896262:0:10285:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127364.896281:0:10285:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729200/0xeeacf7c024300ad9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7bf2 expref: -99 pid: 10285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127364.896347:0:10285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728a00/0xeeacf7c024300ae0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127364.896361:0:10285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728a00/0xeeacf7c024300ae0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127364.896375:0:10285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728a00/0xeeacf7c024300ae0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127364.896388:0:10285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728c00/0xeeacf7c024300ae7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127364.896395:0:10285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728c00/0xeeacf7c024300ae7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127364.896401:0:10285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728c00/0xeeacf7c024300ae7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127364.896729:0:10285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728600/0xeeacf7c024300aee lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127364.896739:0:10285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728600/0xeeacf7c024300aee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127364.896768:0:10285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728600/0xeeacf7c024300aee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789127364.896779:0:10285:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:0.0:1789127364.896890:0:10285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728a00/0xeeacf7c024300ae0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127364.896898:0:10285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728a00/0xeeacf7c024300ae0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127364.896904:0:10285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728a00/0xeeacf7c024300ae0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127364.896911:0:10285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7ae728a00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:0.0:1789127364.896915:0:10285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728a00/0xeeacf7c024300ae0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127364.896922:0:10285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728a00/0xeeacf7c024300ae0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127364.896934:0:10285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8df7906f6b00) 00010000:00010000:0.0:1789127364.896937:0:10285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127364.896942:0:10285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728a00/0xeeacf7c024300ae0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127364.896947:0:10285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728a00/0xeeacf7c024300ae0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127364.896958:0:10285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728c00/0xeeacf7c024300ae7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127364.896963:0:10285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728c00/0xeeacf7c024300ae7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127364.896975:0:10285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728c00/0xeeacf7c024300ae7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127364.896980:0:10285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7ae728c00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:0.0:1789127364.896983:0:10285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728c00/0xeeacf7c024300ae7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127364.896990:0:10285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728c00/0xeeacf7c024300ae7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127364.896998:0:10285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8df782a68d00) 00010000:00010000:0.0:1789127364.897000:0:10285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127364.897003:0:10285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728c00/0xeeacf7c024300ae7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127364.897009:0:10285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728c00/0xeeacf7c024300ae7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127364.897064:0:10285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729200/0xeeacf7c024300ad9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7bf2 expref: 34 pid: 10285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127364.897077:0:10285:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728600/0xeeacf7c024300aee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7bf2 expref: 33 pid: 10285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127364.897084:0:10285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df782d66b00) 00010000:00010000:0.0:1789127364.897086:0:10285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789127364.897089:0:10285:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7ae728600, rc 0) 00000100:00100000:0.0:1789127364.897150:0:10285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae2fa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+33:10690:x1876035733865088:12345-192.168.206.40@tcp:101:cat.0 Request processed in 913us (1115us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1789127364.897169:0:10285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 94 00000100:00100000:1.0:1789127364.906361:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127364.906449:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733865344 00000100:00100000:3.0:1789127364.906458:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733865344 00000100:00100000:3.0:1789127364.906511:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 24 00000100:00100000:3.0:1789127364.906521:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeab8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+33:10690:x1876035733865344:12345-192.168.206.40@tcp:35:cat.0 00000100:00100000:3.0:1789127364.906775:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeab8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+34:10690:x1876035733865344:12345-192.168.206.40@tcp:35:cat.0 Request processed in 254us (422us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1789127364.906784:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 24 00000100:00100000:1.0:1789127364.928249:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127364.928331:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733865600 00000100:00100000:2.0:1789127364.928341:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733865600 00000100:00100000:2.0:1789127364.928395:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 95 00000100:00100000:2.0:1789127364.928405:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeabb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+34:10691:x1876035733865600:12345-192.168.206.40@tcp:36:rm.0 00010000:00010000:2.0:1789127364.928457:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789127364.928482:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728600/0xeeacf7c024300aee lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7bf2 expref: 34 pid: 10285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127364.928502:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024300ac4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7beb expref: 33 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127364.928515:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c024300a8c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7bdd expref: 32 pid: 10285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127364.928524:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df782d66b00) 00010000:00010000:2.0:1789127364.928534:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789127364.928553:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c400/0xeeacf7c024300afc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127364.928565:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c400/0xeeacf7c024300afc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127364.928574:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c400/0xeeacf7c024300afc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127364.928588:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032ca00/0xeeacf7c024300b03 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127364.928611:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032ca00/0xeeacf7c024300b03 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127364.928618:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032ca00/0xeeacf7c024300b03 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127364.928955:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032da00/0xeeacf7c024300b0a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127364.928965:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032da00/0xeeacf7c024300b0a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127364.928972:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032da00/0xeeacf7c024300b0a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789127364.935928:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:2.0:1789127364.935940:0:5830:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 311092151146ns, next at 312092148814ns, rc = 0 00010000:00010000:2.0:1789127364.936007:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032dc00/0xeeacf7c024300b11 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127364.936024:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032dc00/0xeeacf7c024300b11 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127364.936036:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032dc00/0xeeacf7c024300b11 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127364.936046:0:5830:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032dc00/0xeeacf7c024300b11 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127364.940300:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032dc00/0xeeacf7c024300b11 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127364.940330:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032dc00/0xeeacf7c024300b11 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127364.940355:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789127364.940389:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032da00/0xeeacf7c024300b0a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127364.940395:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032da00/0xeeacf7c024300b0a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127364.940401:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032da00/0xeeacf7c024300b0a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127364.940407:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df79032da00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:2.0:1789127364.940412:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032da00/0xeeacf7c024300b0a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127364.940419:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032da00/0xeeacf7c024300b0a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127364.940433:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df7906f6700) 00010000:00010000:2.0:1789127364.940436:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789127364.940440:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032da00/0xeeacf7c024300b0a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127364.940447:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032da00/0xeeacf7c024300b0a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127364.940470:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c400/0xeeacf7c024300afc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127364.940477:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c400/0xeeacf7c024300afc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127364.940489:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c400/0xeeacf7c024300afc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127364.940494:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df79032c400 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:2.0:1789127364.940498:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c400/0xeeacf7c024300afc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127364.940504:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c400/0xeeacf7c024300afc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127364.940513:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8df7906f6b00) 00010000:00010000:2.0:1789127364.940515:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789127364.940518:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c400/0xeeacf7c024300afc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127364.940524:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c400/0xeeacf7c024300afc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789127364.940535:0:5830:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000ae70d023 reply state 00000000b8155605 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032ca00/0xeeacf7c024300b03 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127364.940544:0:5830:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789127364.940638:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeabb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+33:10691:x1876035733865600:12345-192.168.206.40@tcp:36:rm.0 Request processed in 12230us (12393us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1789127364.940647:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 95 00010000:00010000:3.0:1789127364.940758:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789127364.940765:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032dc00/0xeeacf7c024300b11 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127364.940771:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df79032dc00 already unused, calling callback (ffffffffc17a4550) 00010000:00010000:3.0:1789127364.940774:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032dc00/0xeeacf7c024300b11 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127364.940781:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032dc00/0xeeacf7c024300b11 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127364.940815:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df7906f6700) 00010000:00010000:3.0:1789127364.940818:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789127364.940821:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032dc00/0xeeacf7c024300b11 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127364.940827:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032dc00/0xeeacf7c024300b11 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127364.940844:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127364.940846:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127364.940848:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127364.945392:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032ca00/0xeeacf7c024300b03 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127364.945421:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032ca00/0xeeacf7c024300b03 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127364.945428:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032ca00/0xeeacf7c024300b03 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127364.945434:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df79032ca00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:3.0:1789127364.945439:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032ca00/0xeeacf7c024300b03 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127364.945447:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032ca00/0xeeacf7c024300b03 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127364.945462:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8df7906f6900) 00010000:00010000:3.0:1789127364.945465:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127364.945470:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032ca00/0xeeacf7c024300b03 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127364.945476:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032ca00/0xeeacf7c024300b03 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127365.021318:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127365.021468:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733865856 00000100:00100000:2.0:1789127365.021478:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733865856 00000100:00100000:1.0:1789127365.021620:0:12098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 96 00000100:00100000:1.0:1789127365.021630:0:12098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeaba1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+32:10697:x1876035733865856:12345-192.168.206.40@tcp:101:bash.0 00010000:00010000:1.0:1789127365.021655:0:12098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127365.021675:0:12098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024300b18 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7bf9 expref: -99 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.021848:0:12098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024300b1f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.021877:0:12098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024300b1f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.021889:0:12098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024300b1f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.021904:0:12098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97a00/0xeeacf7c024300b26 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.021911:0:12098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97a00/0xeeacf7c024300b26 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.021917:0:12098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97a00/0xeeacf7c024300b26 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789127365.022419:0:12098:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:1.0:1789127365.022572:0:12098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c024300b2d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.022583:0:12098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c024300b2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.022591:0:12098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c024300b2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.022618:0:12098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024300b1f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.022624:0:12098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024300b1f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.022631:0:12098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024300b1f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.022644:0:12098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd97e00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:1.0:1789127365.022648:0:12098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024300b1f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.022654:0:12098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024300b1f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.022665:0:12098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8df7906f6b00) 00010000:00010000:1.0:1789127365.022668:0:12098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789127365.022672:0:12098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024300b1f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.022678:0:12098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024300b1f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789127365.022690:0:12098:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000095869352 reply state 000000009ac293aa transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97a00/0xeeacf7c024300b26 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127365.022698:0:12098:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789127365.022724:0:12098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024300b18 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7bf9 expref: 35 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.022738:0:12098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c024300b2d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7bf9 expref: 34 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.022745:0:12098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8df782d66e00) 00010000:00010000:1.0:1789127365.022758:0:12098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789127365.022761:0:12098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7bbd97600, rc 0) 00000100:00100000:1.0:1789127365.022871:0:12098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeaba1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+35:10697:x1876035733865856:12345-192.168.206.40@tcp:101:bash.0 Request processed in 1242us (1561us total) trans 4294967377 rc 0/0 00000100:00100000:1.0:1789127365.022885:0:12098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 96 00010000:00010000:3.0:1789127365.033188:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97a00/0xeeacf7c024300b26 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127365.033206:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97a00/0xeeacf7c024300b26 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127365.033214:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97a00/0xeeacf7c024300b26 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127365.033220:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd97a00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:3.0:1789127365.033240:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97a00/0xeeacf7c024300b26 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127365.033248:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97a00/0xeeacf7c024300b26 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127365.033263:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8df782d66600) 00010000:00010000:3.0:1789127365.033266:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127365.033271:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97a00/0xeeacf7c024300b26 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127365.033278:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97a00/0xeeacf7c024300b26 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127365.039659:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127365.039767:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733865984 00000100:00100000:2.0:1789127365.039777:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733865984 00000100:00100000:2.0:1789127365.039870:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 34 00000100:00100000:2.0:1789127365.039894:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeab92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+7:2349:x1876035733865984:12345-192.168.206.40@tcp:101:bash.0 00010000:00010000:2.0:1789127365.039911:0:6688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127365.039931:0:6688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ca70d47e/0xeeacf7c024300b3b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7c00 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789127365.039957:0:6688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789127365.039978:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=311s v=(0 0) 00010000:00010000:2.0:1789127365.039983:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127365.039994:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ca70d47e/0xeeacf7c024300b3b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c00 expref: 8 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.040026:0:6688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ca70d47e/0xeeacf7c024300b3b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c00 expref: 8 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.040038:0:6688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df79032c400, rc 0) 00000100:00100000:2.0:1789127365.040099:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeab92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+8:2349:x1876035733865984:12345-192.168.206.40@tcp:101:bash.0 Request processed in 207us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127365.040106:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 34 00000100:00100000:2.0:1789127365.046178:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127365.046275:0:8063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733866112 00000100:00100000:3.0:1789127365.046284:0:8063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733866112 00000100:00100000:3.0:1789127365.046347:0:8063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 35 00000100:00100000:3.0:1789127365.046356:0:8063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae2f8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+8:10697:x1876035733866112:12345-192.168.206.40@tcp:101:bash.0 00010000:00010000:3.0:1789127365.046371:0:8063:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127365.046386:0:8063:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e68250b/0xeeacf7c024300b42 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7c07 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127365.046413:0:8063:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ca70d47e/0xeeacf7c024300b3b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c00 expref: 9 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127365.046422:0:8063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127365.046426:0:8063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127365.046431:0:8063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e68250b/0xeeacf7c024300b42 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c07 expref: 9 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127365.046479:0:8063:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ca70d47e/0xeeacf7c024300b3b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c00 expref: 9 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127365.046492:0:8063:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ca70d47e/0xeeacf7c024300b3b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c00 expref: 9 pid: 6688 timeout: 411 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127365.046506:0:8063:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7aeb16d00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8063:1876035752761216:192.168.206.40@tcp:104: 00000100:00100000:3.0:1789127365.046596:0:8063:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7ae191540 going to sleep for 11 seconds 00010000:00010000:0.0:1789127365.048535:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127365.059524:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127365.059629:0:8063:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7aeb16d00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8063:1876035752761216:192.168.206.40@tcp:104: 00010000:00010000:3.0:1789127365.059662:0:8063:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002e68250b/0xeeacf7c024300b42 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c07 expref: 9 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127365.059681:0:8063:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df798df1000, rc 0) 00000100:00100000:3.0:1789127365.059740:0:8063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae2f8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+9:10697:x1876035733866112:12345-192.168.206.40@tcp:101:bash.0 Request processed in 13384us (13573us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127365.059759:0:8063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 35 00000100:00100000:0.0:1789127365.061223:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733866240 00000100:00100000:0.0:1789127365.061235:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733866240 00010000:00010000:0.0:1789127365.061280:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ca70d47e/0xeeacf7c024300b3b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c00 expref: 9 pid: 6688 timeout: 411 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127365.061326:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 54 00000100:00100000:0.0:1789127365.061345:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeab9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+9:2349:x1876035733866240:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789127365.061360:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789127365.061381:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ca70d47e/0xeeacf7c024300b3b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c00 expref: 9 pid: 6688 timeout: 411 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127365.061395:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ca70d47e/0xeeacf7c024300b3b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c00 expref: 9 pid: 6688 timeout: 411 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127365.061418:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ca70d47e/0xeeacf7c024300b3b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c00 expref: 9 pid: 6688 timeout: 411 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127365.061434:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789127365.061438:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789127365.061446:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002e68250b/0xeeacf7c024300b42 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c07 expref: 8 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127365.061456:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e68250b/0xeeacf7c024300b42 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c07 expref: 8 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127365.061501:0:5817:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000002e68250b/0xeeacf7c024300b42 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c07 expref: 8 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127365.061516:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7bb96d680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5817:1876035752761344:192.168.206.40@tcp:105: 00000100:00100000:0.0:1789127365.061578:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df790702000 going to sleep for 11 seconds 00000100:00100000:0.0:1789127365.067519:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7bb96d680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5817:1876035752761344:192.168.206.40@tcp:105: 00010000:00010000:0.0:1789127365.067543:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789127365.067597:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeab9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+8:2349:x1876035733866240:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 6252us (8080us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127365.067608:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 54 00000100:00100000:2.0:1789127365.070429:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127365.070519:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733866496 00000100:00100000:3.0:1789127365.070528:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733866496 00000100:00100000:3.0:1789127365.070582:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 25 00000100:00100000:3.0:1789127365.070591:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae2f9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+34:10697:x1876035733866496:12345-192.168.206.40@tcp:35:bash.0 00000100:00100000:3.0:1789127365.070971:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae2f9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+35:10697:x1876035733866496:12345-192.168.206.40@tcp:35:bash.0 Request processed in 379us (549us total) trans 4294967378 rc 0/0 00000100:00100000:3.0:1789127365.070980:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 25 00000100:00100000:0.0:1789127365.107073:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7aeb16d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752761472:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789127365.107142:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127365.107249:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752761472 00000100:00100000:3.0:1789127365.107255:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752761472 00000100:00100000:3.0:1789127365.107308:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789127365.107318:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bb96d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3302:x1876035752761472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789127365.107350:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789127365.107396:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bb96d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3302:x1876035752761472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127365.107403:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789127365.107544:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7aeb16d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752761472:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1789127365.225852:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00080000:3.0:1789127365.225867:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00080000:3.0:1789127365.225876:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000100:00100000:1.0:1789127365.243051:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127365.243156:0:10285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733866624 00000100:00100000:0.0:1789127365.243164:0:10285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733866624 00000100:00100000:0.0:1789127365.243224:0:10285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 97 00000100:00100000:0.0:1789127365.243234:0:10285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeab9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+35:10713:x1876035733866624:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:0.0:1789127365.243256:0:10285:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127365.243277:0:10285:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728c00/0xeeacf7c024300b49 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7c0e expref: -99 pid: 10285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127365.243346:0:10285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728a00/0xeeacf7c024300b50 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127365.243374:0:10285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728a00/0xeeacf7c024300b50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127365.243386:0:10285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728a00/0xeeacf7c024300b50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789127365.243457:0:10285:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1789127365.243461:0:10285:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1789127365.243484:0:10285:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728a00/0xeeacf7c024300b50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127365.243508:0:10285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728c00/0xeeacf7c024300b49 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c0e expref: 37 pid: 10285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127365.243528:0:10285:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728a00/0xeeacf7c024300b50 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c0e expref: 36 pid: 10285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127365.243535:0:10285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8df7906f6b00) 00010000:00010000:0.0:1789127365.243538:0:10285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789127365.243541:0:10285:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7ae728a00, rc 0) 00000100:00100000:0.0:1789127365.243597:0:10285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeab9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+36:10713:x1876035733866624:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 365us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127365.243604:0:10285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 97 00000100:00100000:0.0:1789127365.247651:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127365.248159:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733866880 00000100:00100000:2.0:1789127365.248169:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733866880 00000100:00100000:2.0:1789127365.248229:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 98 00000100:00100000:2.0:1789127365.248239:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bb96c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+36:10713:x1876035733866880:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:2.0:1789127365.248257:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127365.248276:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c800/0xeeacf7c024300b57 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7c15 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.248380:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c024300b5e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.248394:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c024300b5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.248405:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c024300b5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789127365.248415:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1789127365.248546:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c800/0xeeacf7c024300b57 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c15 expref: 39 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.248563:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c024300b5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c15 expref: 38 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.248571:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8df782d66e00) 00010000:00010000:2.0:1789127365.248574:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789127365.248578:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df79032c200, rc 0) 00000100:00100000:2.0:1789127365.248643:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bb96c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+38:10713:x1876035733866880:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 406us (1003us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1789127365.248650:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 98 00000100:00100000:2.0:1789127365.252521:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127365.252612:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733867136 00000100:00100000:3.0:1789127365.252621:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733867136 00000100:00100000:3.0:1789127365.252681:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 99 00000100:00100000:3.0:1789127365.252703:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df787b8da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+38:10713:x1876035733867136:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:3.0:1789127365.252738:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127365.252768:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0e00/0xeeacf7c024300b6c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7c1c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127365.253024:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c024300b73 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127365.253038:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c024300b73 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127365.253049:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c024300b73 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789127365.253060:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1789127365.253190:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0e00/0xeeacf7c024300b6c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c1c expref: 41 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127365.253208:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c024300b73 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c1c expref: 40 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127365.253216:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8df782d66e00) 00010000:00010000:3.0:1789127365.253219:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789127365.253222:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df798df1e00, rc 0) 00000100:00100000:3.0:1789127365.253322:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df787b8da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+40:10713:x1876035733867136:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 632us (812us total) trans 4294967380 rc 0/0 00000100:00100000:3.0:1789127365.253330:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 99 00000100:00100000:0.0:1789127365.255974:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127365.259541:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733867264 00000100:00100000:1.0:1789127365.259555:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733867264 00000100:00100000:1.0:1789127365.259633:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 6 00000100:00100000:1.0:1789127365.259644:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bb96e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+40:2349:x1876035733867264:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789127365.259658:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789127365.259682:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c024300b5e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c15 expref: 40 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.259719:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8df782d66e00) 00010000:00010000:1.0:1789127365.259724:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789127365.259784:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bb96e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+39:2349:x1876035733867264:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 141us (3818us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127365.259822:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 6 00000100:00100000:2.0:1789127365.264269:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127365.264421:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733867392 00000100:00100000:3.0:1789127365.264480:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733867392 00000100:00100000:3.0:1789127365.264569:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 36 00000100:00100000:3.0:1789127365.264579:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df788015050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+6:2349:x1876035733867392:12345-192.168.206.40@tcp:1:lfs.0 00010000:00010000:3.0:1789127365.264618:0:6688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd073e3d/0xeeacf7c024300b81 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127365.264637:0:6688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002e68250b/0xeeacf7c024300b42 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c07 expref: 6 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127365.264646:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127365.264650:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789127365.264655:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd073e3d/0xeeacf7c024300b81 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127365.264697:0:6688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002e68250b/0xeeacf7c024300b42 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c07 expref: 6 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127365.264728:0:6688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002e68250b/0xeeacf7c024300b42 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c07 expref: 6 pid: 8063 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127365.264742:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7aeb14f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6688:1876035752761600:192.168.206.40@tcp:104: 00000100:00100000:3.0:1789127365.264873:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7a0334780 going to sleep for 11 seconds 00000100:00100000:1.0:1789127365.267557:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127365.267655:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733867520 00000100:00100000:2.0:1789127365.267663:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733867520 00002000:00100000:2.0:1789127365.267714:0:6693:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8df7aeab8000 x1876035733867520/t0(0) o4->28762f98-a240-4662-a754-e28bbeb6cb4b@192.168.206.40@tcp:101/0 lens 504/0 e 0 to 0 dl 1789127376 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789127365.267757:0:6693:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff8df7aeab8000 with x1876035733867520 ext(0->8) 00010000:00010000:2.0:1789127365.267766:0:6693:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000002e68250b/0xeeacf7c024300b42 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c07 expref: 7 pid: 8063 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.267781:0:6693:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000002e68250b/0xeeacf7c024300b42 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c07 expref: 7 pid: 8063 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789127365.267817:0:6693:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8df7aeab8000 00000100:00100000:2.0:1789127365.267843:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 1 00000100:00100000:2.0:1789127365.267852:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeab8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+7:2348:x1876035733867520:12345-192.168.206.40@tcp:4:lfs.0 00000100:00100000:2.0:1789127365.268371:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeab8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+9:2348:x1876035733867520:12345-192.168.206.40@tcp:4:lfs.0 Request processed in 516us (818us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1789127365.268381:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 1 00002000:00100000:2.0:1789127365.268388:0:6693:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8df7aeab8000 x1876035733867520/t4294967302(0) o4->28762f98-a240-4662-a754-e28bbeb6cb4b@192.168.206.40@tcp:101/0 lens 504/448 e 0 to 0 dl 1789127376 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789127365.268397:0:6693:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff8df7aeab8000 with x1876035733867520 ext(0->8) 00010000:00010000:2.0:1789127365.268403:0:6693:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000002e68250b/0xeeacf7c024300b42 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c07 expref: 9 pid: 8063 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.268417:0:6693:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000002e68250b/0xeeacf7c024300b42 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c07 expref: 9 pid: 8063 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789127365.268425:0:6693:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8df7aeab8000 00000100:00100000:3.0:1789127365.268678:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7aeb14f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6688:1876035752761600:192.168.206.40@tcp:104: 00010000:00010000:3.0:1789127365.268701:0:6688:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bd073e3d/0xeeacf7c024300b81 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127365.271614:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127365.271717:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733867648 00000100:00100000:2.0:1789127365.271739:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733867648 00010000:00010000:2.0:1789127365.271819:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002e68250b/0xeeacf7c024300b42 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c07 expref: 9 pid: 8063 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127365.271859:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 55 00000100:00100000:2.0:1789127365.271869:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7889cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+9:2347:x1876035733867648:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789127365.271884:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789127365.271903:0:5816:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1789127365.271906:0:5816:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1789127364 00002000:00010000:2.0:1789127365.271909:0:5816:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1789127364 00002000:00010000:2.0:1789127365.271911:0:5816:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1789127364 00010000:00010000:2.0:1789127365.271917:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002e68250b/0xeeacf7c024300b42 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c07 expref: 9 pid: 8063 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.271931:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002e68250b/0xeeacf7c024300b42 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c07 expref: 9 pid: 8063 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.271955:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e68250b/0xeeacf7c024300b42 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c07 expref: 9 pid: 8063 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.271973:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789127365.271977:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789127365.271982:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bd073e3d/0xeeacf7c024300b81 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.271991:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd073e3d/0xeeacf7c024300b81 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.272034:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789127365.272080:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7889cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+8:2347:x1876035733867648:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 211us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127365.272088:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 55 00010000:00010000:1.0:1789127365.272190:0:6688:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bd073e3d/0xeeacf7c024300b81 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.272200:0:6688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bd073e3d/0xeeacf7c024300b81 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.272224:0:6688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd073e3d/0xeeacf7c024300b81 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.272240:0:6688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bd073e3d/0xeeacf7c024300b81 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.272247:0:6688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bd073e3d/0xeeacf7c024300b81 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.272254:0:6688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df798df0800 already unused, calling callback (ffffffffc17a4550) 00010000:00010000:1.0:1789127365.272258:0:6688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd073e3d/0xeeacf7c024300b81 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.272267:0:6688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd073e3d/0xeeacf7c024300b81 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.272280:0:6688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bd073e3d/0xeeacf7c024300b81 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.272288:0:6688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd073e3d/0xeeacf7c024300b81 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127365.272338:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df788015050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+7:2349:x1876035733867392:12345-192.168.206.40@tcp:1:lfs.0 Request processed in 7760us (8078us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127365.272346:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 36 00000100:00100000:2.0:1789127365.275095:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127365.275203:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733867904 00000100:00100000:3.0:1789127365.275212:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733867904 00000100:00100000:3.0:1789127365.275262:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 26 00000100:00100000:3.0:1789127365.275272:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df791569050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+39:10713:x1876035733867904:12345-192.168.206.40@tcp:35:lfs.0 00000004:00010000:3.0:1789127365.275327:0:5834:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c024300b73 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c1c expref: 39 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789127365.275590:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:3.0:1789127365.275632:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:3.0:1789127365.275995:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00010000:00010000:3.0:1789127365.276049:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024300b88 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127365.276063:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c024300b2d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7bf9 expref: 43 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127365.276085:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024300b88 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127365.276118:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c024300b2d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7bf9 expref: 43 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127365.276133:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c024300b2d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7bf9 expref: 43 pid: 12098 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127365.276148:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7aeb14f00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5834:1876035752761728:192.168.206.40@tcp:104: 00000100:00100000:3.0:1789127365.276236:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df783973c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789127365.279943:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7aeb14f00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5834:1876035752761728:192.168.206.40@tcp:104: 00010000:00010000:3.0:1789127365.279971:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024300b88 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127365.280085:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127365.280359:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733868032 00000100:00100000:3.0:1789127365.280366:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733868032 00010000:00010000:3.0:1789127365.280401:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c024300b2d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7bf9 expref: 44 pid: 12098 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127365.280450:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 56 00000100:00100000:3.0:1789127365.280460:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df787b8e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+44:2348:x1876035733868032:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789127365.280476:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127365.280483:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c024300b2d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7bf9 expref: 44 pid: 12098 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127365.280514:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c024300b2d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7bf9 expref: 44 pid: 12098 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127365.280536:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c024300b2d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7bf9 expref: 44 pid: 12098 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127365.280551:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8df782d66e00) 00010000:00010000:3.0:1789127365.280556:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024300b88 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127365.280564:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024300b88 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127365.280572:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024300b88 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127365.280696:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127365.280769:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df787b8e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+43:2348:x1876035733868032:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 310us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127365.280777:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 56 00010000:00010000:0.0:1789127365.282244:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024300b88 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127365.282258:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024300b88 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789127365.282633:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000001:00080000:2.0:1789127365.283257:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:2.0:1789127365.283393:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df787b8de00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5834:1876035752761856:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789127365.283577:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127365.283654:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df785497540 going to sleep for 11 seconds 00000100:00100000:3.0:1789127365.283975:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752761856 00000100:00100000:3.0:1789127365.283982:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752761856 00000100:00100000:3.0:1789127365.284071:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789127365.284081:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df787b8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5834:x1876035752761856:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789127365.284188:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df787b8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5834:x1876035752761856:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 107us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127365.284195:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789127365.284266:0:5834:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:2.0:1789127365.284271:0:5834:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:2.0:1789127365.284288:0:5834:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8df7af5cd680, transno 4294967301 00000100:00100000:2.0:1789127365.284308:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df787b8de00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5834:1876035752761856:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1789127365.284737:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:2.0:1789127365.284831:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df787b8de00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5834:1876035752761984:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789127365.284874:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127365.285425:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df785497d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789127365.285497:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752761984 00000100:00100000:0.0:1789127365.285503:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752761984 00000100:00100000:0.0:1789127365.285534:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789127365.285541:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df787b8c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5834:x1876035752761984:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789127365.285853:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df787b8c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5834:x1876035752761984:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 310us (977us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1789127365.285860:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789127365.286078:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df787b8de00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5834:1876035752761984:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1789127365.286138:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:2.0:1789127365.286182:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024300b88 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.286193:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024300b88 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.286211:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024300b88 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.286217:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df798df1c00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:2.0:1789127365.286222:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024300b88 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.286230:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024300b88 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.286245:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8df782d66e00) 00010000:00010000:2.0:1789127365.286248:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789127365.286252:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024300b88 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.286258:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024300b88 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789127365.286618:0:5834:0:(mdd_object.c:4024:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789127365.286950:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:2.0:1789127365.286963:0:5834:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 311443174106ns, next at 312443171523ns, rc = 0 00000001:00080000:2.0:1789127365.286972:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:2.0:1789127365.287016:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8df782d66e00) 00010000:00010000:2.0:1789127365.287020:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789127365.287028:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c024300b73 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c1c expref: 47 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127365.287174:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df791569050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+46:10713:x1876035733867904:12345-192.168.206.40@tcp:35:lfs.0 Request processed in 11903us (12087us total) trans 4294967389 rc 0/0 00000100:00100000:2.0:1789127365.287196:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 26 00000020:00080000:2.0:1789127365.287201:0:5834:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1789127365.290145:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127365.290235:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733868160 00000100:00100000:1.0:1789127365.290243:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733868160 00000100:00100000:1.0:1789127365.290315:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 100 00000100:00100000:1.0:1789127365.290337:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df787b8ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+46:10713:x1876035733868160:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:1.0:1789127365.290358:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127365.290378:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96200/0xeeacf7c024300b8f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7c23 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.290429:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96200/0xeeacf7c024300b8f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c23 expref: 47 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.290457:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96200/0xeeacf7c024300b8f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c23 expref: 47 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.290474:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8df782d66800) 00010000:00010000:1.0:1789127365.290477:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789127365.290481:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7bbd96200, rc 0) 00000100:00100000:1.0:1789127365.290535:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df787b8ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+47:10713:x1876035733868160:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 201us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127365.290542:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 100 00000100:00100000:0.0:1789127365.293063:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127365.293138:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733868416 00000100:00100000:2.0:1789127365.293148:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733868416 00000100:00100000:2.0:1789127365.293240:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 27 00000100:00100000:2.0:1789127365.293250:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bb96cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+47:10713:x1876035733868416:12345-192.168.206.40@tcp:35:lfs.0 00000100:00100000:2.0:1789127365.293475:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bb96cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+48:10713:x1876035733868416:12345-192.168.206.40@tcp:35:lfs.0 Request processed in 226us (419us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1789127365.293483:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 27 00000100:00100000:3.0:1789127365.366782:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127365.367231:0:12098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733868544 00000100:00100000:1.0:1789127365.367242:0:12098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733868544 00000100:00100000:1.0:1789127365.367307:0:12098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 101 00000100:00100000:1.0:1789127365.367318:0:12098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeb14f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+48:10723:x1876035733868544:12345-192.168.206.40@tcp:34:lfs.0 00010000:00010000:1.0:1789127365.367772:0:12098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024300b96 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.367812:0:12098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024300b96 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.367825:0:12098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024300b96 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.367851:0:12098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96800/0xeeacf7c024300b9d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.367859:0:12098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96800/0xeeacf7c024300b9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.367866:0:12098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96800/0xeeacf7c024300b9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.367969:0:12098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c024300ba4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.367977:0:12098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c024300ba4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.367984:0:12098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c024300ba4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789127365.368022:0:12098:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c024300ba4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.368035:0:12098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024300b96 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.368041:0:12098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024300b96 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.368048:0:12098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024300b96 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.368054:0:12098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd96000 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:1.0:1789127365.368058:0:12098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024300b96 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.368072:0:12098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024300b96 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.368085:0:12098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8df7906f6b00) 00010000:00010000:1.0:1789127365.368088:0:12098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789127365.368093:0:12098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024300b96 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.368100:0:12098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024300b96 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.368112:0:12098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96800/0xeeacf7c024300b9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.368118:0:12098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96800/0xeeacf7c024300b9d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.368124:0:12098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96800/0xeeacf7c024300b9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.368129:0:12098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd96800 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:1.0:1789127365.368132:0:12098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96800/0xeeacf7c024300b9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.368138:0:12098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96800/0xeeacf7c024300b9d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.368145:0:12098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8df782d66700) 00010000:00010000:1.0:1789127365.368147:0:12098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789127365.368150:0:12098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96800/0xeeacf7c024300b9d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.368164:0:12098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96800/0xeeacf7c024300b9d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.368178:0:12098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c024300ba4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.368184:0:12098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c024300ba4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.368189:0:12098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c024300ba4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.368194:0:12098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd97600 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:1.0:1789127365.368197:0:12098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c024300ba4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.368203:0:12098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c024300ba4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.368210:0:12098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8df782d66800) 00010000:00010000:1.0:1789127365.368212:0:12098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789127365.368215:0:12098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c024300ba4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.368221:0:12098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c024300ba4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127365.368297:0:12098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeb14f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+48:10723:x1876035733868544:12345-192.168.206.40@tcp:34:lfs.0 Request processed in 979us (1523us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127365.368305:0:12098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 101 00000100:00100000:0.0:1789127365.406331:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127365.406443:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733868800 00000100:00100000:3.0:1789127365.406454:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733868800 00000100:00100000:3.0:1789127365.406518:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 102 00000100:00100000:3.0:1789127365.406528:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bb96f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+48:10726:x1876035733868800:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:3.0:1789127365.406552:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127365.406576:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0e00/0xeeacf7c024300bab lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7c2a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127365.406677:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c024300bb2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127365.406695:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c024300bb2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127365.406706:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c024300bb2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127365.406722:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024300bb9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127365.406934:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024300bb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127365.406942:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024300bb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127365.407190:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1000/0xeeacf7c024300bc0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127365.407200:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1000/0xeeacf7c024300bc0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127365.407218:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1000/0xeeacf7c024300bc0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789127365.407229:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1789127365.407327:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c024300bb2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127365.407335:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c024300bb2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127365.407340:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c024300bb2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127365.407346:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df798df1e00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:3.0:1789127365.407351:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c024300bb2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127365.407358:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c024300bb2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127365.407371:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8df7906f6b00) 00010000:00010000:3.0:1789127365.407374:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127365.407379:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c024300bb2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127365.407385:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c024300bb2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127365.407398:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024300bb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127365.407403:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024300bb9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127365.407416:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024300bb9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127365.407421:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df798df1c00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:3.0:1789127365.407424:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024300bb9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127365.408166:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024300bb9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127365.408183:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8df79f06ce00) 00010000:00010000:3.0:1789127365.408186:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127365.408189:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024300bb9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127365.408196:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024300bb9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127365.408260:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0e00/0xeeacf7c024300bab lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c2a expref: 51 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127365.408278:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1000/0xeeacf7c024300bc0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c2a expref: 50 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127365.408285:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8df782d66800) 00010000:00010000:3.0:1789127365.408287:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789127365.408290:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df798df1000, rc 0) 00000100:00100000:3.0:1789127365.408357:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bb96f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+50:10726:x1876035733868800:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 1830us (2037us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1789127365.408376:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 102 00000100:00100000:1.0:1789127365.412115:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127365.412210:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733868928 00000100:00100000:2.0:1789127365.412220:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733868928 00000100:00100000:2.0:1789127365.412283:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 103 00000100:00100000:2.0:1789127365.412292:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeab92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+50:10726:x1876035733868928:12345-192.168.206.40@tcp:54:lfs.0 00010000:00010000:2.0:1789127365.412355:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032dc00/0xeeacf7c024300bce lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.412372:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032dc00/0xeeacf7c024300bce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.412384:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032dc00/0xeeacf7c024300bce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.412408:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032dc00/0xeeacf7c024300bce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.412415:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032dc00/0xeeacf7c024300bce lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.412439:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032dc00/0xeeacf7c024300bce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.412445:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df79032dc00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:2.0:1789127365.412449:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032dc00/0xeeacf7c024300bce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.412456:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032dc00/0xeeacf7c024300bce lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.412469:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8df782d66800) 00010000:00010000:2.0:1789127365.412472:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789127365.412477:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032dc00/0xeeacf7c024300bce lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.412483:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032dc00/0xeeacf7c024300bce lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127365.412561:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeab92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+50:10726:x1876035733868928:12345-192.168.206.40@tcp:54:lfs.0 Request processed in 269us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127365.412569:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 103 00000100:00100000:2.0:1789127365.414624:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127365.414685:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733869184 00000100:00100000:3.0:1789127365.414693:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733869184 00000100:00100000:3.0:1789127365.414758:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 28 00000100:00100000:3.0:1789127365.414767:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae2f9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+50:10726:x1876035733869184:12345-192.168.206.40@tcp:35:lfs.0 00000100:00100000:3.0:1789127365.415423:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae2f9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+51:10726:x1876035733869184:12345-192.168.206.40@tcp:35:lfs.0 Request processed in 654us (803us total) trans 4294967392 rc 0/0 00000100:00100000:3.0:1789127365.415432:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 28 00000100:00100000:3.0:1789127365.484770:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127365.484842:0:12098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733869440 00000100:00100000:1.0:1789127365.484851:0:12098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733869440 00000100:00100000:1.0:1789127365.484912:0:12098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 104 00000100:00100000:1.0:1789127365.484923:0:12098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeb16940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+51:10736:x1876035733869440:12345-192.168.206.40@tcp:101:bash.0 00010000:00010000:1.0:1789127365.484946:0:12098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127365.484949:0:12098:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789127365.484975:0:12098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728a00/0xeeacf7c024300b50 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c0e expref: 51 pid: 10285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.484993:0:12098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8df7906f6b00) 00010000:00010000:1.0:1789127365.485009:0:12098:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789127365.485022:0:12098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96800/0xeeacf7c024300bd5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7c31 expref: -99 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.485112:0:12098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024300bdc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.485125:0:12098:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1000/0xeeacf7c024300bc0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c2a expref: 51 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.485134:0:12098:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024300bdc lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.485163:0:12098:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1000/0xeeacf7c024300bc0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c2a expref: 51 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.485178:0:12098:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1000/0xeeacf7c024300bc0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c2a expref: 51 pid: 5832 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127365.485210:0:12098:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7aeab83c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12098:1876035752762112:192.168.206.40@tcp:104: 00000100:00100000:1.0:1789127365.485306:0:12098:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7aeaaf300 going to sleep for 11 seconds 00000100:00100000:1.0:1789127365.489327:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127365.489373:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733869568 00000100:00100000:1.0:1789127365.489381:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733869568 00010000:00010000:1.0:1789127365.489421:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1000/0xeeacf7c024300bc0 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c2a expref: 52 pid: 5832 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127365.489456:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 57 00000100:00100000:1.0:1789127365.489466:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeaba940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+52:2349:x1876035733869568:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789127365.489480:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789127365.489487:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1000/0xeeacf7c024300bc0 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c2a expref: 52 pid: 5832 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.489498:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1000/0xeeacf7c024300bc0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c2a expref: 52 pid: 5832 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.489521:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8df782d66800) 00010000:00010000:1.0:1789127365.489526:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024300bdc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.489535:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024300bdc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.489543:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024300bdc lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.489578:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789127365.489623:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeaba940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+52:2349:x1876035733869568:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 159us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127365.489631:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 57 00010000:00010000:3.0:1789127365.489948:0:12098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1000/0xeeacf7c024300bc0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c2a expref: 51 pid: 5832 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127365.489966:0:12098:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7aeab83c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12098:1876035752762112:192.168.206.40@tcp:104: 00010000:00010000:3.0:1789127365.489987:0:12098:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024300bdc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127365.490007:0:12098:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024300bdc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127365.490013:0:12098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024300bdc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789127365.490030:0:12098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1789127365.490160:0:12098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96800/0xeeacf7c024300bd5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c31 expref: 52 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127365.490175:0:12098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024300bdc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c31 expref: 51 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127365.490190:0:12098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8df782d66800) 00010000:00010000:3.0:1789127365.490193:0:12098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789127365.490195:0:12098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7bbd96000, rc 0) 00000100:00100000:3.0:1789127365.490227:0:12098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeb16940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+51:10736:x1876035733869440:12345-192.168.206.40@tcp:101:bash.0 Request processed in 5307us (5468us total) trans 4294967393 rc 0/0 00000100:00100000:3.0:1789127365.490234:0:12098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 104 00000100:00100000:1.0:1789127365.495903:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127365.495983:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733869824 00000100:00100000:3.0:1789127365.496003:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733869824 00000100:00100000:3.0:1789127365.496064:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 105 00000100:00100000:3.0:1789127365.496074:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeab9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+51:10736:x1876035733869824:12345-192.168.206.40@tcp:36:bash.0 00010000:00010000:3.0:1789127365.496311:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0e00/0xeeacf7c024300bea lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127365.496344:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0e00/0xeeacf7c024300bea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127365.496356:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0e00/0xeeacf7c024300bea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789127365.496410:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967394 00000004:00010000:3.0:1789127365.496434:0:5832:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000003858e6ed reply state 000000001838d264 transno 4294967395 ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0e00/0xeeacf7c024300bea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127365.496443:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789127365.496538:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeab9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+54:10736:x1876035733869824:12345-192.168.206.40@tcp:36:bash.0 Request processed in 464us (642us total) trans 4294967395 rc 0/0 00000100:00100000:3.0:1789127365.496546:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 105 00000020:00080000:3.0:1789127365.496565:0:5832:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789127365.498279:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0e00/0xeeacf7c024300bea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127365.498294:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0e00/0xeeacf7c024300bea lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127365.498301:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0e00/0xeeacf7c024300bea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127365.498306:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df798df0e00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:0.0:1789127365.498311:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0e00/0xeeacf7c024300bea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127365.498318:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0e00/0xeeacf7c024300bea lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127365.498343:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8df782d66800) 00010000:00010000:0.0:1789127365.498346:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127365.498352:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0e00/0xeeacf7c024300bea lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127365.498373:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0e00/0xeeacf7c024300bea lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127365.500480:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127365.500582:0:10285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733869952 00000100:00100000:0.0:1789127365.500591:0:10285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733869952 00000100:00100000:0.0:1789127365.500691:0:10285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 106 00000100:00100000:0.0:1789127365.500701:0:10285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeab8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+53:10736:x1876035733869952:12345-192.168.206.40@tcp:101:bash.0 00010000:00010000:0.0:1789127365.500733:0:10285:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127365.500763:0:10285:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729200/0xeeacf7c024300bf1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7c38 expref: -99 pid: 10285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127365.500866:0:10285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c024300bf8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127365.500944:0:10285:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024300bdc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c31 expref: 54 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127365.500954:0:10285:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c024300bf8 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127365.500988:0:10285:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024300bdc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c31 expref: 54 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127365.501014:0:10285:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024300bdc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c31 expref: 54 pid: 12098 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127365.501028:0:10285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7bb96c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10285:1876035752762240:192.168.206.40@tcp:104: 00000100:00100000:0.0:1789127365.501113:0:10285:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df790702e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789127365.503416:0:10285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7bb96c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10285:1876035752762240:192.168.206.40@tcp:104: 00010000:00010000:0.0:1789127365.503444:0:10285:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c024300bf8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127365.503851:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127365.503991:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733870080 00000100:00100000:2.0:1789127365.504072:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733870080 00010000:00010000:2.0:1789127365.504107:0:8454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024300bdc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c31 expref: 55 pid: 12098 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127365.504145:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 58 00000100:00100000:2.0:1789127365.504155:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeaba580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+55:2348:x1876035733870080:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789127365.504189:0:8454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789127365.504197:0:8454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024300bdc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c31 expref: 55 pid: 12098 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.504210:0:8454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024300bdc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c31 expref: 55 pid: 12098 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.504232:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024300bdc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c31 expref: 55 pid: 12098 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.504245:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8df782d66800) 00010000:00010000:2.0:1789127365.504250:0:8454:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c024300bf8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.504260:0:8454:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c024300bf8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.504267:0:8454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c024300bf8 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.504330:0:8454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789127365.504386:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeaba580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+54:2348:x1876035733870080:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 231us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127365.504393:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 58 00010000:00010000:0.0:1789127365.505519:0:10285:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c024300bf8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127365.505532:0:10285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c024300bf8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789127365.505574:0:10285:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1789127365.505578:0:10285:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789127365.505601:0:10285:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c024300bf8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127365.505634:0:10285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729200/0xeeacf7c024300bf1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c38 expref: 54 pid: 10285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127365.505652:0:10285:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c024300bf8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c38 expref: 53 pid: 10285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127365.505660:0:10285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8df782d66800) 00010000:00010000:0.0:1789127365.505663:0:10285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789127365.505666:0:10285:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7ae729c00, rc 0) 00000100:00100000:0.0:1789127365.506066:0:10285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeab8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+53:10736:x1876035733869952:12345-192.168.206.40@tcp:101:bash.0 Request processed in 5363us (5591us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127365.506076:0:10285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 106 00000100:00100000:1.0:1789127365.509147:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127365.509240:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733870336 00000100:00100000:2.0:1789127365.509249:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733870336 00000100:00100000:2.0:1789127365.509303:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 29 00000100:00100000:2.0:1789127365.509312:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeabb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+53:10736:x1876035733870336:12345-192.168.206.40@tcp:35:bash.0 00000100:00100000:2.0:1789127365.509575:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeabb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+54:10736:x1876035733870336:12345-192.168.206.40@tcp:35:bash.0 Request processed in 263us (434us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1789127365.509583:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 29 00000100:00100000:3.0:1789127365.563537:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127365.564045:0:12098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733870464 00000100:00100000:1.0:1789127365.564054:0:12098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733870464 00000100:00100000:1.0:1789127365.564141:0:12098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 107 00000100:00100000:1.0:1789127365.564152:0:12098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeb15680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+54:10742:x1876035733870464:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:1.0:1789127365.564176:0:12098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127365.564196:0:12098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97a00/0xeeacf7c024300bff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7c3f expref: -99 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.564258:0:12098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024300c06 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.564272:0:12098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024300c06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.564284:0:12098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024300c06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789127365.564341:0:12098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:1.0:1789127365.564344:0:12098:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1789127365.564366:0:12098:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024300c06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.564403:0:12098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97a00/0xeeacf7c024300bff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c3f expref: 56 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.564419:0:12098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024300c06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c3f expref: 55 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.564427:0:12098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8df7906f6b00) 00010000:00010000:1.0:1789127365.564444:0:12098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789127365.564448:0:12098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7bbd96000, rc 0) 00000100:00100000:1.0:1789127365.564503:0:12098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeb15680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+55:10742:x1876035733870464:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 353us (975us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127365.564510:0:12098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 107 00000100:00100000:1.0:1789127365.568208:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127365.568286:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733870592 00000100:00100000:2.0:1789127365.568294:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733870592 00000100:00100000:2.0:1789127365.568378:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 108 00000100:00100000:2.0:1789127365.568387:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeab8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+55:10742:x1876035733870592:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:2.0:1789127365.568404:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127365.568421:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032dc00/0xeeacf7c024300c0d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7c46 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.568491:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032ca00/0xeeacf7c024300c14 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.568505:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032ca00/0xeeacf7c024300c14 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.568515:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032ca00/0xeeacf7c024300c14 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.568529:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c400/0xeeacf7c024300c1b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.568536:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c400/0xeeacf7c024300c1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.568543:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c400/0xeeacf7c024300c1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.568628:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c024300c22 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.568653:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c024300c22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.568660:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c024300c22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789127365.568696:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789127365.568700:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789127365.568729:0:5831:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c024300c22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.568741:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c024300c22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.568757:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032ca00/0xeeacf7c024300c14 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.568763:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032ca00/0xeeacf7c024300c14 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.568770:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032ca00/0xeeacf7c024300c14 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.568775:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df79032ca00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:2.0:1789127365.568780:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032ca00/0xeeacf7c024300c14 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.568826:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032ca00/0xeeacf7c024300c14 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.568841:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8df7906f6b00) 00010000:00010000:2.0:1789127365.568843:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789127365.568855:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032ca00/0xeeacf7c024300c14 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.568860:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032ca00/0xeeacf7c024300c14 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.568873:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c400/0xeeacf7c024300c1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.568878:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c400/0xeeacf7c024300c1b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.568883:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c400/0xeeacf7c024300c1b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.568888:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df79032c400 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:2.0:1789127365.568890:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c400/0xeeacf7c024300c1b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.568896:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c400/0xeeacf7c024300c1b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.568902:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8df7906f6100) 00010000:00010000:2.0:1789127365.568904:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789127365.568907:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c400/0xeeacf7c024300c1b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.568912:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c400/0xeeacf7c024300c1b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.568940:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032dc00/0xeeacf7c024300c0d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c46 expref: 57 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.568966:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c024300c22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c46 expref: 56 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.568974:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8df782d66800) 00010000:00010000:2.0:1789127365.568976:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789127365.568979:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df79032c200, rc 0) 00000100:00100000:2.0:1789127365.569042:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeab8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+56:10742:x1876035733870592:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 655us (841us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127365.569049:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 108 00000100:00100000:0.0:1789127365.575691:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127365.575858:0:10285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733870848 00000100:00100000:3.0:1789127365.575868:0:10285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733870848 00000100:00100000:3.0:1789127365.575924:0:10285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 109 00000100:00100000:3.0:1789127365.575934:0:10285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bb96c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+56:10742:x1876035733870848:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:3.0:1789127365.575954:0:10285:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127365.575974:0:10285:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1000/0xeeacf7c024300c29 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7c4d expref: -99 pid: 10285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127365.576074:0:10285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024300c30 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127365.576089:0:10285:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c024300bf8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c38 expref: 57 pid: 10285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127365.576098:0:10285:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c024300c22 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c46 expref: 57 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127365.576106:0:10285:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024300c30 lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127365.576142:0:10285:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c024300c22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c46 expref: 57 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127365.576157:0:10285:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c024300c22 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c46 expref: 57 pid: 5831 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127365.576171:0:10285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7aeb16580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10285:1876035752762368:192.168.206.40@tcp:104: 00010000:00010000:3.0:1789127365.576396:0:10285:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c024300bf8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c38 expref: 57 pid: 10285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127365.576406:0:10285:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c024300bf8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c38 expref: 57 pid: 10285 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127365.576415:0:10285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7aeb17c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10285:1876035752762496:192.168.206.40@tcp:104: 00000100:00100000:3.0:1789127365.576442:0:10285:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df783973c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789127365.579083:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127365.579253:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733870976 00000100:00100000:2.0:1789127365.579262:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733870976 00010000:00010000:2.0:1789127365.579299:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c024300c22 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c46 expref: 58 pid: 5831 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127365.579338:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 59 00000100:00100000:2.0:1789127365.579347:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeabad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+58:2348:x1876035733870976:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789127365.579361:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789127365.579368:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c024300c22 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c46 expref: 58 pid: 5831 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.579381:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c024300c22 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c46 expref: 58 pid: 5831 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.579402:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8df782d66800) 00010000:00010000:2.0:1789127365.579407:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024300c30 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.579426:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024300c30 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.579446:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789127365.579498:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeabad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+58:2348:x1876035733870976:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 151us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127365.579506:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 59 00000100:00100000:3.0:1789127365.583453:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00010000:00010000:0.0:1789127365.583672:0:10285:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.206.40@tcp) returned -22 from blocking AST (req@0000000089b08b18 x1876035752762368) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c024300c22 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c46 expref: 57 pid: 5831 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127365.583727:0:10285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c024300c22 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c46 expref: 57 pid: 5831 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127365.583755:0:10285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7aeb16580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10285:1876035752762368:192.168.206.40@tcp:104: 00000100:00100000:0.0:1789127365.583773:0:10285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7aeb17c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10285:1876035752762496:192.168.206.40@tcp:104: 00010000:00010000:0.0:1789127365.583881:0:10285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8df782d66800) 00010000:00010000:0.0:1789127365.583888:0:10285:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024300c30 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127365.583897:0:10285:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024300c30 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127365.583906:0:10285:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024300c30 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127365.584061:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733871104 00000100:00100000:2.0:1789127365.584069:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733871104 00010000:00010000:2.0:1789127365.584108:0:8454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c024300bf8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c38 expref: 57 pid: 10285 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127365.584147:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 60 00000100:00100000:2.0:1789127365.584158:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeb16d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+57:2349:x1876035733871104:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789127365.584172:0:8454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789127365.584178:0:8454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c024300bf8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c38 expref: 57 pid: 10285 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.584189:0:8454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c024300bf8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c38 expref: 57 pid: 10285 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.584209:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c024300bf8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c38 expref: 57 pid: 10285 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.584220:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8df782d66800) 00010000:00010000:2.0:1789127365.584223:0:8454:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024300c30 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.584239:0:8454:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024300c30 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.584246:0:8454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024300c30 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.584278:0:8454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789127365.584333:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeb16d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+56:2349:x1876035733871104:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 175us (888us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127365.584341:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 60 00010000:00010000:0.0:1789127365.584397:0:10285:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024300c30 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127365.584405:0:10285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024300c30 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789127365.584423:0:10285:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1789127365.584566:0:10285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1000/0xeeacf7c024300c29 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c4d expref: 57 pid: 10285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127365.584583:0:10285:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024300c30 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c4d expref: 56 pid: 10285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127365.584602:0:10285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8df782d66800) 00010000:00010000:0.0:1789127365.584604:0:10285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789127365.584607:0:10285:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df798df1c00, rc 0) 00000100:00100000:0.0:1789127365.584634:0:10285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bb96c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+56:10742:x1876035733870848:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 8702us (8954us total) trans 4294967397 rc 0/0 00000100:00100000:0.0:1789127365.584641:0:10285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 109 00000100:00100000:0.0:1789127365.587350:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127365.587934:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733871360 00000100:00100000:2.0:1789127365.587944:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733871360 00000100:00100000:2.0:1789127365.588044:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 7 00000100:00100000:2.0:1789127365.588053:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bb96e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+56:10742:x1876035733871360:12345-192.168.206.40@tcp:103:lfs.0 00010000:00010000:2.0:1789127365.588071:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789127365.588096:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96200/0xeeacf7c024300b8f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c23 expref: 56 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.588113:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8df782d66800) 00010000:00010000:2.0:1789127365.588118:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789127365.588173:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bb96e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+55:10742:x1876035733871360:12345-192.168.206.40@tcp:103:lfs.0 Request processed in 120us (831us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127365.588181:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 7 00000100:00100000:0.0:1789127365.590351:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127365.590424:0:12098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733871488 00000100:00100000:1.0:1789127365.590443:0:12098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733871488 00000100:00100000:1.0:1789127365.590493:0:12098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 110 00000100:00100000:1.0:1789127365.590502:0:12098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bb96cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+55:10742:x1876035733871488:12345-192.168.206.40@tcp:58:lfs.0 00010000:00010000:1.0:1789127365.590592:0:12098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024300c3e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.590609:0:12098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024300c3e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.590621:0:12098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024300c3e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789127365.591076:0:12098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:1.0:1789127365.591209:0:12098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bb96cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+55:10742:x1876035733871488:12345-192.168.206.40@tcp:58:lfs.0 Request processed in 707us (865us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127365.591218:0:12098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 110 00000100:00100000:0.0:1789127365.594052:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127365.594135:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733871616 00000100:00100000:2.0:1789127365.594145:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733871616 00000100:00100000:2.0:1789127365.594238:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 111 00000100:00100000:2.0:1789127365.594248:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bb96f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+55:10742:x1876035733871616:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:2.0:1789127365.594281:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127365.594302:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032dc00/0xeeacf7c024300c45 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7c54 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.594355:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024300c3e lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.594367:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032dc00/0xeeacf7c024300c45 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c54 expref: 56 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.594385:0:5831:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024300c3e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.594398:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032dc00/0xeeacf7c024300c45 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c54 expref: 56 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.594410:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8df782d66800) 00010000:00010000:2.0:1789127365.594414:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789127365.594417:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032dc00/0xeeacf7c024300c45 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c54 expref: 56 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.594425:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df79032dc00, rc 0) 00000100:00100000:2.0:1789127365.594593:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bb96f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+56:10742:x1876035733871616:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 346us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127365.594601:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 111 00000040:00080000:1.0:1789127365.875020:0:12084:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789127365.875030:0:12084:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789127365.875088:0:12084:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1789127365.875096:0:12084:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789127365.875228:0:12084:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7aeabb0c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12084:1876035752762624:192.168.206.40@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789127365.875340:0:12084:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7aeaafb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789127365.879448:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127365.879533:0:10285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733871744 00000100:00100000:3.0:1789127365.879542:0:10285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733871744 00000100:00100000:3.0:1789127365.879603:0:10285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 112 00000100:00100000:3.0:1789127365.879612:0:10285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bb96e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+57:10743:x1876035733871744:12345-192.168.206.40@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789127365.879643:0:10285:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789127365.879774:0:10285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bb96e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+57:10743:x1876035733871744:12345-192.168.206.40@tcp:53:lhsmtool_posix.0 Request processed in 162us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127365.879781:0:10285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 112 00000100:00100000:1.0:1789127365.881941:0:12084:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7aeabb0c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12084:1876035752762624:192.168.206.40@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789127365.885581:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127365.886234:0:12098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733871872 00000100:00100000:1.0:1789127365.886244:0:12098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733871872 00000100:00100000:1.0:1789127365.886307:0:12098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 113 00000100:00100000:1.0:1789127365.886317:0:12098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bb96e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+56:10743:x1876035733871872:12345-192.168.206.40@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789127365.886385:0:12098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024300c4c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.886402:0:12098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024300c4c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.886416:0:12098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024300c4c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.886444:0:12098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c024300c53 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.886451:0:12098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c024300c53 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.886475:0:12098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c024300c53 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.886498:0:12098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96800/0xeeacf7c024300c5a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.886507:0:12098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96800/0xeeacf7c024300c5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.886513:0:12098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96800/0xeeacf7c024300c5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789127365.886550:0:12098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1789127365.886554:0:12098:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789127365.886567:0:12098:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96800/0xeeacf7c024300c5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.886577:0:12098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024300c4c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.886584:0:12098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024300c4c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.886591:0:12098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024300c4c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.886597:0:12098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd97e00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:1.0:1789127365.886602:0:12098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024300c4c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.886609:0:12098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024300c4c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.886628:0:12098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8df79f06c900) 00010000:00010000:1.0:1789127365.886632:0:12098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789127365.886638:0:12098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024300c4c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.886644:0:12098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024300c4c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.886657:0:12098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c024300c53 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.886664:0:12098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c024300c53 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.886670:0:12098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c024300c53 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.886674:0:12098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd96600 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:1.0:1789127365.886677:0:12098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c024300c53 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.886682:0:12098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c024300c53 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.886689:0:12098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff8df782d66700) 00010000:00010000:1.0:1789127365.886691:0:12098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789127365.886694:0:12098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c024300c53 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.886700:0:12098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c024300c53 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.886724:0:12098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96800/0xeeacf7c024300c5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.886731:0:12098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96800/0xeeacf7c024300c5a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.886736:0:12098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96800/0xeeacf7c024300c5a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.886741:0:12098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd96800 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:1.0:1789127365.886754:0:12098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96800/0xeeacf7c024300c5a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.886761:0:12098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96800/0xeeacf7c024300c5a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.886768:0:12098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8df782d66800) 00010000:00010000:1.0:1789127365.886771:0:12098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789127365.886774:0:12098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96800/0xeeacf7c024300c5a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.886779:0:12098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96800/0xeeacf7c024300c5a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127365.887027:0:12098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bb96e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+56:10743:x1876035733871872:12345-192.168.206.40@tcp:34:lhsmtool_posix.0 Request processed in 709us (1454us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127365.887035:0:12098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 113 00000100:00100000:0.0:1789127365.892202:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127365.892286:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733872128 00000100:00100000:1.0:1789127365.892295:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733872128 00000100:00100000:1.0:1789127365.892352:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 114 00000100:00100000:1.0:1789127365.892376:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bb96ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+56:10743:x1876035733872128:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789127365.892396:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127365.892417:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c024300c61 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7c5b expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.892507:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c024300c68 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.892521:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c024300c68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.892533:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c024300c68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789127365.892544:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1789127365.892627:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c024300c68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.892635:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c024300c68 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.892641:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c024300c68 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.892647:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd97600 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:1.0:1789127365.892651:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c024300c68 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.892659:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c024300c68 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.892670:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8df782d66800) 00010000:00010000:1.0:1789127365.892678:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789127365.892683:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c024300c68 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.892689:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c024300c68 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.892757:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c024300c61 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c5b expref: 58 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.892768:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8df79f06c900) 00010000:00010000:1.0:1789127365.892770:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789127365.892774:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c024300c61 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c5b expref: 58 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.892783:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7bbd97800, rc 0) 00000100:00100000:1.0:1789127365.892867:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bb96ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+57:10743:x1876035733872128:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 Request processed in 493us (674us total) trans 4294967398 rc 301/301 00000100:00100000:1.0:1789127365.892874:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 114 00000100:00100000:3.0:1789127365.898985:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127365.899107:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733872256 00000100:00100000:2.0:1789127365.899117:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733872256 00000100:00100000:2.0:1789127365.899172:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 115 00000100:00100000:2.0:1789127365.899198:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeb17c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+57:10743:x1876035733872256:12345-192.168.206.40@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789127365.899231:0:5830:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789127365.899341:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeb17c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+57:10743:x1876035733872256:12345-192.168.206.40@tcp:53:lhsmtool_posix.0 Request processed in 146us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127365.899350:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 115 00000100:00100000:0.0:1789127365.905998:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127365.906101:0:12098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733872512 00000100:00100000:1.0:1789127365.906110:0:12098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733872512 00000100:00100000:1.0:1789127365.906177:0:12098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 116 00000100:00100000:1.0:1789127365.906187:0:12098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79206cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+57:10743:x1876035733872512:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789127365.906208:0:12098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127365.906211:0:12098:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789127365.906238:0:12098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024300c06 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c3f expref: 57 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.906257:0:12098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8df7906f6b00) 00010000:00010000:1.0:1789127365.906279:0:12098:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789127365.906295:0:12098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c024300c76 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7c62 expref: -99 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789127365.906699:0:12098:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:1.0:1789127365.906983:0:12098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c024300c7d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.906997:0:12098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c024300c7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.907008:0:12098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c024300c7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.907055:0:12098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c024300c76 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c62 expref: 59 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.907070:0:12098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c024300c7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c62 expref: 58 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.907077:0:12098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8df782d66700) 00010000:00010000:1.0:1789127365.907080:0:12098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789127365.907082:0:12098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7bbd97600, rc 0) 00000100:00100000:1.0:1789127365.907572:0:12098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79206cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+58:10743:x1876035733872512:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 Request processed in 1383us (1580us total) trans 4294967399 rc 0/0 00000100:00100000:1.0:1789127365.907582:0:12098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 116 00000100:00100000:1.0:1789127365.921668:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127365.922650:0:10285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733872768 00000100:00100000:3.0:1789127365.922661:0:10285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733872768 00000100:00100000:3.0:1789127365.922741:0:10285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 117 00000100:00100000:3.0:1789127365.922759:0:10285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeabb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+58:10743:x1876035733872768:12345-192.168.206.40@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789127365.922853:0:10285:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127365.923110:0:10285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c024300c7d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c62 expref: 58 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127365.923146:0:10285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8df782d66700) 00010000:00010000:3.0:1789127365.923157:0:10285:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789127365.923239:0:10285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c400/0xeeacf7c024300c8b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.923255:0:10285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c400/0xeeacf7c024300c8b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.923265:0:10285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c400/0xeeacf7c024300c8b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.923281:0:10285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032ca00/0xeeacf7c024300c92 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xe72316ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.923288:0:10285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032ca00/0xeeacf7c024300c92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xe72316ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.923294:0:10285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032ca00/0xeeacf7c024300c92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xe72316ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.923384:0:10285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c400/0xeeacf7c024300c8b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.923391:0:10285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c400/0xeeacf7c024300c8b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.923397:0:10285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c400/0xeeacf7c024300c8b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.923412:0:10285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df79032c400 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:2.0:1789127365.923417:0:10285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c400/0xeeacf7c024300c8b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.923424:0:10285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c400/0xeeacf7c024300c8b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.923444:0:10285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8df7906f6b00) 00010000:00010000:2.0:1789127365.923447:0:10285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789127365.923452:0:10285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c400/0xeeacf7c024300c8b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.923458:0:10285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c400/0xeeacf7c024300c8b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.923468:0:10285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032ca00/0xeeacf7c024300c92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xe72316ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.923474:0:10285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032ca00/0xeeacf7c024300c92 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xe72316ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.923480:0:10285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032ca00/0xeeacf7c024300c92 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xe72316ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.923485:0:10285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df79032ca00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:2.0:1789127365.923487:0:10285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032ca00/0xeeacf7c024300c92 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xe72316ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.923492:0:10285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032ca00/0xeeacf7c024300c92 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xe72316ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.923510:0:10285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xe72316ea (ffff8df7906f6100) 00010000:00010000:2.0:1789127365.923512:0:10285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789127365.923515:0:10285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032ca00/0xeeacf7c024300c92 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xe72316ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.923520:0:10285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032ca00/0xeeacf7c024300c92 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xe72316ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127365.923607:0:10285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeabb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+57:10743:x1876035733872768:12345-192.168.206.40@tcp:36:lhsmtool_posix.0 Request processed in 848us (1946us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789127365.923614:0:10285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 117 00000100:00100000:3.0:1789127365.927542:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127365.927621:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733872896 00000100:00100000:2.0:1789127365.927630:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733872896 00000100:00100000:2.0:1789127365.927700:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 118 00000100:00100000:2.0:1789127365.927718:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeb16580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+57:10743:x1876035733872896:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789127365.927737:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127365.927770:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032da00/0xeeacf7c024300c99 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7c69 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.927838:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c800/0xeeacf7c024300ca0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.927852:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c800/0xeeacf7c024300ca0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.927869:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c800/0xeeacf7c024300ca0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.927971:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032da00/0xeeacf7c024300c99 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c69 expref: 59 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.927995:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c800/0xeeacf7c024300ca0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c69 expref: 58 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.928003:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8df7906f6f00) 00010000:00010000:2.0:1789127365.928006:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789127365.928009:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df79032c800, rc 0) 00000100:00100000:2.0:1789127365.928061:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeb16580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+58:10743:x1876035733872896:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 Request processed in 352us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127365.928068:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 118 00000100:00100000:0.0:1789127365.932626:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127365.932734:0:12098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733873152 00000100:00100000:1.0:1789127365.932756:0:12098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733873152 00000100:00100000:1.0:1789127365.932869:0:12098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 119 00000100:00100000:1.0:1789127365.932881:0:12098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79206e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+58:10743:x1876035733873152:12345-192.168.206.40@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789127365.932959:0:12098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c024300ca7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.932976:0:12098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c024300ca7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127365.932988:0:12098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c024300ca7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789127365.933220:0:12098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00010000:1.0:1789127365.933309:0:12098:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000d03ecc32 reply state 00000000a80f89a2 transno 4294967400 ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c024300ca7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127365.933318:0:12098:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789127365.933423:0:12098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79206e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+60:10743:x1876035733873152:12345-192.168.206.40@tcp:36:lhsmtool_posix.0 Request processed in 544us (805us total) trans 4294967400 rc 0/0 00000100:00100000:1.0:1789127365.933431:0:12098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 119 00010000:00010000:3.0:1789127365.936990:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c024300ca7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127365.937007:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c024300ca7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127365.937015:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c024300ca7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127365.937020:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd97800 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:3.0:1789127365.937026:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c024300ca7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127365.937033:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c024300ca7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127365.937050:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8df7906f6f00) 00010000:00010000:3.0:1789127365.937053:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789127365.937058:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c024300ca7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127365.937064:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c024300ca7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127365.937531:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127365.947950:0:10285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733873280 00000100:00100000:2.0:1789127365.947966:0:10285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733873280 00000100:00100000:2.0:1789127365.948096:0:10285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 120 00000100:00100000:2.0:1789127365.948108:0:10285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df78efcf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+59:10743:x1876035733873280:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789127365.948131:0:10285:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127365.948151:0:10285:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032da00/0xeeacf7c024300cae lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7c70 expref: -99 pid: 10285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.948210:0:10285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032da00/0xeeacf7c024300cae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c70 expref: 60 pid: 10285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.948222:0:10285:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032da00/0xeeacf7c024300cae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c70 expref: 60 pid: 10285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.948239:0:10285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8df7906f6f00) 00010000:00010000:2.0:1789127365.948242:0:10285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789127365.948259:0:10285:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df79032da00, rc 0) 00000100:00100000:2.0:1789127365.948346:0:10285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df78efcf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+60:10743:x1876035733873280:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 Request processed in 223us (10802us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127365.948354:0:10285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 120 00000100:00100000:0.0:1789127365.961316:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127365.961545:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733873408 00000100:00100000:2.0:1789127365.961555:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733873408 00000100:00100000:2.0:1789127365.961608:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 37 00000100:00100000:2.0:1789127365.961617:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df78efced00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+8:2348:x1876035733873408:12345-192.168.206.40@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789127365.962102:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df78efced00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+9:2348:x1876035733873408:12345-192.168.206.40@tcp:2:lhsmtool_posix.0 Request processed in 485us (796us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1789127365.962110:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 37 00000100:00100000:0.0:1789127365.972621:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127365.972820:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733873664 00000100:00100000:2.0:1789127365.972828:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733873664 00000100:00100000:2.0:1789127365.972893:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 30 00000100:00100000:2.0:1789127365.972903:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df78efcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+60:10743:x1876035733873664:12345-192.168.206.40@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789127365.973110:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df78efcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+61:10743:x1876035733873664:12345-192.168.206.40@tcp:35:lhsmtool_posix.0 Request processed in 208us (498us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1789127365.973119:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 30 00000100:00100000:0.0:1789127365.975809:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127365.978917:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733873920 00000100:00100000:1.0:1789127365.978930:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733873920 00000100:00100000:1.0:1789127365.979001:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 121 00000100:00100000:1.0:1789127365.979011:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df78efcda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+61:10743:x1876035733873920:12345-192.168.206.40@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789127365.979115:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df78efcda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+61:10743:x1876035733873920:12345-192.168.206.40@tcp:57:lhsmtool_posix.0 Request processed in 105us (3404us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127365.979124:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 121 00000100:00100000:0.0:1789127365.984654:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127365.985739:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733874048 00000100:00100000:2.0:1789127365.985759:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733874048 00000100:00100000:2.0:1789127365.985854:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 122 00000100:00100000:2.0:1789127365.985876:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df78efccf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+61:10743:x1876035733874048:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789127365.985897:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127365.985917:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032ca00/0xeeacf7c024300cb5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7c77 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.986006:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c400/0xeeacf7c024300cbc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.986020:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c400/0xeeacf7c024300cbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.986030:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c400/0xeeacf7c024300cbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789127365.986064:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789127365.986082:0:5830:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c400/0xeeacf7c024300cbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.986107:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032ca00/0xeeacf7c024300cb5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c77 expref: 63 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.986124:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c400/0xeeacf7c024300cbc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c77 expref: 62 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127365.986132:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8df7906f6f00) 00010000:00010000:2.0:1789127365.986135:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789127365.986138:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df79032c400, rc 0) 00000100:00100000:2.0:1789127365.986191:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df78efccf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+62:10743:x1876035733874048:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 Request processed in 319us (1545us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127365.986198:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 122 00000100:00100000:0.0:1789127365.996638:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127365.997103:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733874176 00000100:00100000:3.0:1789127365.997113:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733874176 00000100:00100000:3.0:1789127365.997175:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 38 00000100:00100000:3.0:1789127365.997199:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79a3a12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+9:2349:x1876035733874176:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789127365.997219:0:6689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127365.997241:0:6689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000135bd677/0xeeacf7c024300cc3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7c7e expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789127365.997266:0:6689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa3eac5, blocks: 0x1 00010000:00010000:3.0:1789127365.997286:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=312s v=(0 0) 00010000:00010000:3.0:1789127365.997291:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127365.997300:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000135bd677/0xeeacf7c024300cc3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c7e expref: 10 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127365.997318:0:6689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000135bd677/0xeeacf7c024300cc3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c7e expref: 10 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127365.997331:0:6689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df798df1e00, rc 0) 00000100:00100000:3.0:1789127365.997397:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79a3a12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+10:2349:x1876035733874176:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 Request processed in 200us (769us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127365.997404:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 38 00000100:00100000:0.0:1789127366.001201:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127366.001288:0:10285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733874432 00000100:00100000:2.0:1789127366.001298:0:10285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733874432 00000100:00100000:2.0:1789127366.001377:0:10285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 123 00000100:00100000:2.0:1789127366.001400:0:10285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b43161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+62:10743:x1876035733874432:12345-192.168.206.40@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789127366.001510:0:10285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b43161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+62:10743:x1876035733874432:12345-192.168.206.40@tcp:57:lhsmtool_posix.0 Request processed in 111us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127366.001518:0:10285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 123 00000100:00080000:3.0:1789127366.001705:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789127366.007928:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127366.008158:0:8063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733874560 00000100:00100000:3.0:1789127366.008169:0:8063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733874560 00000100:00100000:3.0:1789127366.008238:0:8063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 39 00000100:00100000:3.0:1789127366.008248:0:8063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae058b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+10:10743:x1876035733874560:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789127366.008264:0:8063:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127366.008281:0:8063:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bd073e3d/0xeeacf7c024300cca lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7c85 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127366.008328:0:8063:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000135bd677/0xeeacf7c024300cc3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c7e expref: 11 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127366.008338:0:8063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127366.008342:0:8063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127366.008348:0:8063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bd073e3d/0xeeacf7c024300cca lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c85 expref: 11 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127366.008381:0:8063:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000135bd677/0xeeacf7c024300cc3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c7e expref: 11 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127366.008395:0:8063:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000135bd677/0xeeacf7c024300cc3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c7e expref: 11 pid: 6689 timeout: 412 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127366.008410:0:8063:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7aeae6d00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8063:1876035752762752:192.168.206.40@tcp:104: 00000100:00100000:3.0:1789127366.008500:0:8063:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df783973600 going to sleep for 11 seconds 00000100:00080000:1.0:1789127366.008566:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789127366.015645:0:8063:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7aeae6d00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8063:1876035752762752:192.168.206.40@tcp:104: 00010000:00010000:3.0:1789127366.015700:0:8063:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bd073e3d/0xeeacf7c024300cca lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c85 expref: 11 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127366.015733:0:8063:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df798df0800, rc 0) 00000100:00100000:3.0:1789127366.015848:0:8063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae058b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+11:10743:x1876035733874560:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 Request processed in 7600us (7928us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127366.015858:0:8063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 39 00000100:00100000:0.0:1789127366.023129:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127366.023470:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733874688 00000100:00100000:2.0:1789127366.023480:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733874688 00010000:00010000:2.0:1789127366.023521:0:8454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000135bd677/0xeeacf7c024300cc3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c7e expref: 11 pid: 6689 timeout: 412 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127366.023565:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 61 00000100:00100000:2.0:1789127366.023575:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7889ca050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+11:2348:x1876035733874688:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789127366.023590:0:8454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789127366.023613:0:8454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000135bd677/0xeeacf7c024300cc3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c7e expref: 11 pid: 6689 timeout: 412 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127366.023627:0:8454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000135bd677/0xeeacf7c024300cc3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c7e expref: 11 pid: 6689 timeout: 412 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127366.023650:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000135bd677/0xeeacf7c024300cc3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c7e expref: 11 pid: 6689 timeout: 412 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127366.023669:0:8454:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127366.023674:0:8454:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127366.023682:0:8454:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bd073e3d/0xeeacf7c024300cca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c85 expref: 10 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127366.023939:0:8454:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bd073e3d/0xeeacf7c024300cca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c85 expref: 10 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127366.023975:0:8454:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000bd073e3d/0xeeacf7c024300cca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c85 expref: 10 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127366.023989:0:8454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae2f9e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8454:1876035752762880:192.168.206.40@tcp:105: 00000100:00100000:2.0:1789127366.024054:0:8454:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df782cb8900 going to sleep for 11 seconds 00000100:00100000:2.0:1789127366.028113:0:8454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae2f9e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8454:1876035752762880:192.168.206.40@tcp:105: 00010000:00010000:2.0:1789127366.028141:0:8454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789127366.028201:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7889ca050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+10:2348:x1876035733874688:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 4627us (5082us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127366.028212:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 61 00000100:00100000:0.0:1789127366.029674:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127366.029969:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733874816 00000100:00100000:1.0:1789127366.029978:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733874816 00002000:00100000:1.0:1789127366.030040:0:6692:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8df7ae058f00 x1876035733874816/t0(0) o4->28762f98-a240-4662-a754-e28bbeb6cb4b@192.168.206.40@tcp:102/0 lens 504/0 e 0 to 0 dl 1789127377 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789127366.030051:0:6692:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff8df7ae058f00 with x1876035733874816 ext(0->12) 00002000:00010000:1.0:1789127366.030057:0:6692:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df7ae058f00 00000100:00100000:1.0:1789127366.030089:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 2 00000100:00100000:1.0:1789127366.030099:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae058f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+10:2348:x1876035733874816:12345-192.168.206.40@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789127366.030730:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae058f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+12:2348:x1876035733874816:12345-192.168.206.40@tcp:4:lhsmtool_posix.0 Request processed in 628us (1056us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1789127366.030739:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 2 00002000:00100000:1.0:1789127366.030757:0:6692:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8df7ae058f00 x1876035733874816/t4294967308(0) o4->28762f98-a240-4662-a754-e28bbeb6cb4b@192.168.206.40@tcp:102/0 lens 504/448 e 0 to 0 dl 1789127377 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789127366.030766:0:6692:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff8df7ae058f00 with x1876035733874816 ext(0->12) 00002000:00010000:1.0:1789127366.030771:0:6692:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df7ae058f00 00000100:00100000:1.0:1789127366.050286:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127366.050367:0:12098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733874944 00000100:00100000:3.0:1789127366.050377:0:12098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733874944 00000100:00100000:3.0:1789127366.050435:0:12098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 124 00000100:00100000:3.0:1789127366.050444:0:12098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeabbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+62:10743:x1876035733874944:12345-192.168.206.40@tcp:44:lhsmtool_posix.0 00010000:00010000:2.0:1789127366.069839:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127366.131967:0:12098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeabbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+62:10743:x1876035733874944:12345-192.168.206.40@tcp:44:lhsmtool_posix.0 Request processed in 81513us (81680us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127366.131982:0:12098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 124 00000001:00080000:0.0:1789127366.132199:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967397 is committed 00000020:00080000:0.0:1789127366.132211:0:5852:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000001:00080000:0.0:1789127366.132250:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000001:00080000:0.0:1789127366.132287:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967401 is committed 00000004:00080000:0.0:1789127366.132297:0:5852:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:0.0:1789127366.132310:0:5852:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8df785497540 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1789127366.132314:0:5852:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8df7bfc3a400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8df7854979c0 00000020:00080000:0.0:1789127366.132317:0:5852:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8df7bfc3ad00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8df7ae2a4800 00000004:00080000:0.0:1789127366.132326:0:5852:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:0.0:1789127366.132385:0:5852:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8df7ae191840 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1789127366.132388:0:5852:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8df7b4057200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8df7ae191600 00000020:00080000:0.0:1789127366.132391:0:5852:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8df7b4057600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8df7b4111c00 00000100:00100000:1.0:1789127366.132912:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789127366.132929:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7aeaba940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752763008:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789127366.132986:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127366.133122:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7aeaba580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1876035752763136:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789127366.133148:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127366.133183:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752763008 00000100:00100000:1.0:1789127366.133189:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752763008 00000100:00100000:1.0:1789127366.133232:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752763136 00000100:00100000:1.0:1789127366.133235:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752763136 00000100:00100000:1.0:1789127366.133258:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789127366.133266:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeabad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3302:x1876035752763008:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789127366.133303:0:6689:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:1.0:1789127366.133471:0:6689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aa3eac4, atime: 0x6aa3eac4, ctime: 0x6aa3eac4, blocks: 0x1 00010000:00010000:1.0:1789127366.133480:0:6689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028c8830a/0xeeacf7c024300cd1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.133496:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=312s v=(0 0) 00010000:00010000:1.0:1789127366.133500:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789127366.133506:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028c8830a/0xeeacf7c024300cd1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.133521:0:6689:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028c8830a/0xeeacf7c024300cd1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.133530:0:6689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028c8830a/0xeeacf7c024300cd1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.133538:0:6689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000028c8830a/0xeeacf7c024300cd1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.133556:0:6689:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000020:00080000:3.0:1789127366.133854:0:5863:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:3.0:1789127366.134037:0:5863:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00010000:00010000:3.0:1789127366.134907:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789127366.134916:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000028c8830a/0xeeacf7c024300cd1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127366.134929:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd96800 already unused, calling callback (ffffffffc17a4550) 00010000:00010000:3.0:1789127366.134933:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000028c8830a/0xeeacf7c024300cd1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127366.134944:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000028c8830a/0xeeacf7c024300cd1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127366.134964:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000028c8830a/0xeeacf7c024300cd1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127366.134972:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028c8830a/0xeeacf7c024300cd1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789127366.135090:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789127366.135096:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789127366.135120:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789127366.135133:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeab83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3300:x1876035752763136:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789127366.135156:0:6688:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:0.0:1789127366.135174:0:6688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000acbca3e3/0xeeacf7c024300cd8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127366.135189:0:6688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b830ec46/0xeeacf7c024300a93 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7be4 expref: 11 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127366.135197:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1789127366.135201:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789127366.135206:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000acbca3e3/0xeeacf7c024300cd8 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127366.135249:0:6688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b830ec46/0xeeacf7c024300a93 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7be4 expref: 11 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127366.135264:0:6688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b830ec46/0xeeacf7c024300a93 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7be4 expref: 11 pid: 6689 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127366.135278:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae05b0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6688:1876035752763264:192.168.206.40@tcp:104: 00000100:00100000:1.0:1789127366.135905:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeabad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3302:x1876035752763008:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2637us (2917us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1789127366.135915:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000004:00080000:1.0:1789127366.135975:0:3302:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8df7aeaba940/2, rc 0, transno 4294967304 00000100:00100000:1.0:1789127366.135981:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7aeaba940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752763008:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789127366.136152:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7889e9180 going to sleep for 11 seconds 00010000:00010000:3.0:1789127366.136596:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127366.136608:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127366.136610:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127366.139663:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127366.140766:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae05b0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6688:1876035752763264:192.168.206.40@tcp:104: 00010000:00010000:0.0:1789127366.140809:0:6688:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000acbca3e3/0xeeacf7c024300cd8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127366.141607:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733875072 00000100:00100000:1.0:1789127366.141632:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733875072 00010000:00010000:1.0:1789127366.141673:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b830ec46/0xeeacf7c024300a93 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7be4 expref: 12 pid: 6689 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127366.141728:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 62 00000100:00100000:1.0:1789127366.141738:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeae6d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+12:2349:x1876035733875072:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789127366.141766:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789127366.141772:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b830ec46/0xeeacf7c024300a93 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7be4 expref: 12 pid: 6689 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.141818:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b830ec46/0xeeacf7c024300a93 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7be4 expref: 12 pid: 6689 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.141845:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b830ec46/0xeeacf7c024300a93 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7be4 expref: 12 pid: 6689 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.141866:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789127366.141870:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789127366.141876:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000acbca3e3/0xeeacf7c024300cd8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.141886:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000acbca3e3/0xeeacf7c024300cd8 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.141916:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789127366.141968:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeae6d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+11:2349:x1876035733875072:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 231us (2313us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127366.141984:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 62 00010000:00010000:1.0:1789127366.142286:0:6688:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000acbca3e3/0xeeacf7c024300cd8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.142297:0:6688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000acbca3e3/0xeeacf7c024300cd8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.142306:0:6688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000acbca3e3/0xeeacf7c024300cd8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.142313:0:6688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000acbca3e3/0xeeacf7c024300cd8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.142630:0:6688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789127366.142831:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789127366.142839:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000acbca3e3/0xeeacf7c024300cd8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127366.142848:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7ae729400 already unused, calling callback (ffffffffc17a4550) 00010000:00010000:2.0:1789127366.142853:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000acbca3e3/0xeeacf7c024300cd8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127366.142863:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000acbca3e3/0xeeacf7c024300cd8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127366.142894:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000acbca3e3/0xeeacf7c024300cd8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127366.142902:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000acbca3e3/0xeeacf7c024300cd8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127366.142922:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127366.142924:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127366.142925:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127366.143538:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127366.143946:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733875200 00000100:00100000:3.0:1789127366.143955:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733875200 00000100:00100000:3.0:1789127366.144009:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 42 00000100:00100000:3.0:1789127366.144020:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae05b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+11:2349:x1876035733875200:12345-192.168.206.40@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1789127366.146367:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeab83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3300:x1876035752763136:12345-0@lo:6:osp-syn-1-0.0 Request processed in 11231us (13210us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1789127366.146382:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000004:00080000:3.0:1789127366.147007:0:3300:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8df7aeaba580/2, rc 0, transno 4294967309 00000100:00100000:3.0:1789127366.147023:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7aeaba580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1876035752763136:0@lo:6:osp-syn-1-0.0 00000001:00080000:0.0:1789127366.225059:0:7646:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:0.0:1789127366.225076:0:7646:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:0.0:1789127366.225081:0:7646:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:1.0:1789127366.225234:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae05b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+6:2349:x1876035733875200:12345-192.168.206.40@tcp:16:lhsmtool_posix.0 Request processed in 81212us (81696us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127366.225245:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 42 00000100:00100000:0.0:1789127366.230552:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127366.230642:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733875456 00000100:00100000:3.0:1789127366.230652:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733875456 00000100:00100000:3.0:1789127366.230723:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 125 00000100:00100000:3.0:1789127366.230733:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae059e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+15:10743:x1876035733875456:12345-192.168.206.40@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789127366.230823:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127366.230850:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c400/0xeeacf7c024300cbc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c77 expref: 15 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127366.230869:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8df7906f6f00) 00010000:00010000:3.0:1789127366.230875:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789127366.230904:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024300cdf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127366.230918:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024300cdf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127366.230928:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024300cdf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789127366.231158:0:5832:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000004d679a06 reply state 000000004f1acf7a transno 4294967402 ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024300cdf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127366.231181:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789127366.231268:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae059e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+16:10743:x1876035733875456:12345-192.168.206.40@tcp:36:lhsmtool_posix.0 Request processed in 535us (725us total) trans 4294967402 rc 0/0 00000100:00100000:3.0:1789127366.231276:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 125 00010000:00010000:3.0:1789127366.238409:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024300cdf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127366.238425:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024300cdf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127366.238442:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024300cdf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127366.238449:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df798df0200 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:3.0:1789127366.238453:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024300cdf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127366.238461:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024300cdf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127366.238476:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8df7906f6f00) 00010000:00010000:3.0:1789127366.238479:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127366.238484:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024300cdf lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127366.238490:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024300cdf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127366.246207:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127366.246295:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733875584 00000100:00100000:3.0:1789127366.246305:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733875584 00000100:00100000:3.0:1789127366.246388:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 43 00000100:00100000:3.0:1789127366.246397:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae059680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+6:2348:x1876035733875584:12345-192.168.206.40@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789127366.246620:0:6686:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1789127366.246624:0:6686:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1789127364 00002000:00010000:3.0:1789127366.246627:0:6686:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1789127364 00002000:00010000:3.0:1789127366.246629:0:6686:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1789127365 -> 1789127364 00002000:00010000:3.0:1789127366.246631:0:6686:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1789127366.246695:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae059680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+7:2348:x1876035733875584:12345-192.168.206.40@tcp:2:lhsmtool_posix.0 Request processed in 298us (495us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1789127366.246703:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 43 00000100:00100000:0.0:1789127366.252170:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127366.252263:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733875840 00000100:00100000:1.0:1789127366.252272:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733875840 00000100:00100000:1.0:1789127366.252348:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 126 00000100:00100000:1.0:1789127366.252359:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae05b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+15:10743:x1876035733875840:12345-192.168.206.40@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1789127366.252429:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024300ce6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.252467:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c800/0xeeacf7c024300ca0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c69 expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.252476:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024300ce6 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.252509:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c800/0xeeacf7c024300ca0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c69 expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.252521:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c800/0xeeacf7c024300ca0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c69 expref: 15 pid: 5832 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127366.252535:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7aeab8f00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5831:1876035752763392:192.168.206.40@tcp:104: 00000100:00100000:1.0:1789127366.252629:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7aeaaf300 going to sleep for 11 seconds 00000100:00100000:2.0:1789127366.256688:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7aeab8f00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5831:1876035752763392:192.168.206.40@tcp:104: 00010000:00010000:2.0:1789127366.256731:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024300ce6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127366.258157:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127366.258242:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733875968 00000100:00100000:3.0:1789127366.258250:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733875968 00010000:00010000:3.0:1789127366.258285:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c800/0xeeacf7c024300ca0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c69 expref: 16 pid: 5832 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127366.258325:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 63 00000100:00100000:3.0:1789127366.258347:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae919a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+16:2349:x1876035733875968:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789127366.258360:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127366.258366:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c800/0xeeacf7c024300ca0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c69 expref: 16 pid: 5832 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127366.258379:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c800/0xeeacf7c024300ca0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c69 expref: 16 pid: 5832 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127366.258398:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c800/0xeeacf7c024300ca0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c69 expref: 16 pid: 5832 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127366.258431:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8df7906f6f00) 00010000:00010000:3.0:1789127366.258435:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024300ce6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127366.258443:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024300ce6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127366.258450:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024300ce6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127366.258481:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127366.258532:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae919a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+15:2349:x1876035733875968:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 187us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127366.258540:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 63 00010000:00010000:1.0:1789127366.258694:0:5831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024300ce6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.258702:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024300ce6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.258733:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024300ce6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.258750:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024300ce6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.258757:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024300ce6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.258775:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd97e00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:1.0:1789127366.258779:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024300ce6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.258835:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024300ce6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.258846:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8df7906f6f00) 00010000:00010000:1.0:1789127366.258848:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1789127366.258853:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024300ce6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.258858:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024300ce6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127366.258900:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae05b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+14:10743:x1876035733875840:12345-192.168.206.40@tcp:55:lhsmtool_posix.0 Request processed in 6544us (6740us total) trans 0 rc -22/-22 00000100:00100000:1.0:1789127366.258908:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 126 00000100:00100000:1.0:1789127366.266324:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127366.266426:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733876096 00000100:00100000:0.0:1789127366.266435:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733876096 00000100:00100000:0.0:1789127366.266490:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 44 00000100:00100000:0.0:1789127366.266500:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeab9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+7:2349:x1876035733876096:12345-192.168.206.40@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789127366.266556:0:6688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000003a7963f3/0xeeacf7c024300ced lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127366.266574:0:6688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bd073e3d/0xeeacf7c024300cca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c85 expref: 7 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127366.266582:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789127366.266587:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789127366.266592:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003a7963f3/0xeeacf7c024300ced lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127366.266622:0:6688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bd073e3d/0xeeacf7c024300cca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c85 expref: 7 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127366.266636:0:6688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bd073e3d/0xeeacf7c024300cca lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c85 expref: 7 pid: 8063 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127366.266651:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae918f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6688:1876035752763520:192.168.206.40@tcp:104: 00000100:00100000:0.0:1789127366.266759:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7889e9b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789127366.269632:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae918f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6688:1876035752763520:192.168.206.40@tcp:104: 00010000:00010000:1.0:1789127366.269661:0:6688:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003a7963f3/0xeeacf7c024300ced lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127366.283916:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127366.284189:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733876224 00000100:00100000:2.0:1789127366.284198:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733876224 00010000:00010000:2.0:1789127366.284239:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bd073e3d/0xeeacf7c024300cca lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c85 expref: 8 pid: 8063 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127366.284275:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 64 00000100:00100000:2.0:1789127366.284285:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeab8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+8:2349:x1876035733876224:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789127366.284300:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789127366.284323:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bd073e3d/0xeeacf7c024300cca lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c85 expref: 8 pid: 8063 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127366.284354:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bd073e3d/0xeeacf7c024300cca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c85 expref: 8 pid: 8063 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127366.284393:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bd073e3d/0xeeacf7c024300cca lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c85 expref: 8 pid: 8063 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127366.284413:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789127366.284418:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789127366.284424:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003a7963f3/0xeeacf7c024300ced lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127366.284446:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003a7963f3/0xeeacf7c024300ced lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127366.284481:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789127366.284545:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeab8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+7:2349:x1876035733876224:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 260us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127366.284553:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 64 00010000:00010000:1.0:1789127366.284862:0:6688:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003a7963f3/0xeeacf7c024300ced lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.284873:0:6688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003a7963f3/0xeeacf7c024300ced lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.284905:0:6688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000003a7963f3/0xeeacf7c024300ced lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.284914:0:6688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003a7963f3/0xeeacf7c024300ced lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.284922:0:6688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003a7963f3/0xeeacf7c024300ced lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.284929:0:6688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7ae729e00 already unused, calling callback (ffffffffc17a4550) 00010000:00010000:1.0:1789127366.284933:0:6688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003a7963f3/0xeeacf7c024300ced lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.284942:0:6688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003a7963f3/0xeeacf7c024300ced lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.284955:0:6688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003a7963f3/0xeeacf7c024300ced lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.284963:0:6688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003a7963f3/0xeeacf7c024300ced lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127366.287535:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeab9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+6:2349:x1876035733876096:12345-192.168.206.40@tcp:1:lhsmtool_posix.0 Request processed in 21025us (21208us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127366.287549:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 44 00000100:00100000:0.0:1789127366.300287:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127366.300504:0:12098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733876480 00000100:00100000:3.0:1789127366.300513:0:12098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733876480 00000100:00100000:3.0:1789127366.300576:0:12098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 127 00000100:00100000:3.0:1789127366.300586:0:12098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae918f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+14:10743:x1876035733876480:12345-192.168.206.40@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789127366.300659:0:12098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024300cf4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127366.300677:0:12098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024300cf4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127366.300701:0:12098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024300cf4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127366.302153:0:12098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c024300cfb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127366.302183:0:12098:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032da00/0xeeacf7c024300cae lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c70 expref: 15 pid: 10285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127366.302192:0:12098:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c024300cfb lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127366.302227:0:12098:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032da00/0xeeacf7c024300cae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c70 expref: 15 pid: 10285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127366.302243:0:12098:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032da00/0xeeacf7c024300cae lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c70 expref: 15 pid: 10285 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127366.302258:0:12098:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7b4333c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12098:1876035752763648:192.168.206.40@tcp:104: 00000100:00100000:3.0:1789127366.302383:0:12098:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7a0334300 going to sleep for 11 seconds 00000100:00100000:0.0:1789127366.318966:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127366.319140:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733876608 00000100:00100000:1.0:1789127366.319148:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733876608 00010000:00010000:1.0:1789127366.319189:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032da00/0xeeacf7c024300cae lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c70 expref: 16 pid: 10285 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127366.319231:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 65 00000100:00100000:1.0:1789127366.319241:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6811c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+16:2348:x1876035733876608:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789127366.319255:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789127366.319263:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032da00/0xeeacf7c024300cae lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c70 expref: 16 pid: 10285 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.319275:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032da00/0xeeacf7c024300cae lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c70 expref: 16 pid: 10285 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.319297:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8df7906f6f00) 00010000:00010000:1.0:1789127366.319304:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c024300cfb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.319314:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c024300cfb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.319321:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c024300cfb lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.319341:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789127366.319393:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6811c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+16:2348:x1876035733876608:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 152us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127366.319400:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 65 00010000:00010000:3.0:1789127366.320173:0:12098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032da00/0xeeacf7c024300cae lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c70 expref: 15 pid: 10285 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127366.320191:0:12098:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7b4333c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12098:1876035752763648:192.168.206.40@tcp:104: 00010000:00010000:3.0:1789127366.320210:0:12098:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c024300cfb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127366.320219:0:12098:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c024300cfb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127366.320223:0:12098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c024300cfb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789127366.320403:0:12098:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:3.0:1789127366.320561:0:12098:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:3.0:1789127366.320608:0:12098:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:3.0:1789127366.320686:0:12098:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7b4333c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12098:1876035752763776:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1789127366.321578:0:12098:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127366.321606:0:12098:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df682e65780 going to sleep for 11 seconds 00000100:00100000:0.0:1789127366.322827:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752763776 00000100:00100000:0.0:1789127366.322840:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752763776 00000100:00100000:0.0:1789127366.322898:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789127366.322908:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b4330780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:12098:x1876035752763776:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1789127366.323023:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b4330780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:12098:x1876035752763776:12345-0@lo:1000:mdt00_004.0 Request processed in 116us (1446us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127366.323043:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789127366.323262:0:12098:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:1.0:1789127366.323274:0:12098:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:1.0:1789127366.323291:0:12098:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8df7aeaba580, transno 4294967309 00000100:00100000:1.0:1789127366.323314:0:12098:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7b4333c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12098:1876035752763776:0@lo:1000:mdt00_004.0 00000001:00080000:1.0:1789127366.323783:0:12098:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:1.0:1789127366.323887:0:12098:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a385a40 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12098:1876035752763904:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1789127366.323930:0:12098:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127366.323947:0:12098:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7aeaaf300 going to sleep for 11 seconds 00000100:00100000:3.0:1789127366.324606:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752763904 00000100:00100000:3.0:1789127366.324613:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752763904 00000100:00100000:3.0:1789127366.324645:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789127366.324652:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79a3852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:12098:x1876035752763904:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1789127366.324872:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79a3852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:12098:x1876035752763904:12345-0@lo:1000:mdt00_004.0 Request processed in 219us (941us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1789127366.324879:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789127366.325285:0:12098:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a385a40 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12098:1876035752763904:0@lo:1000:mdt00_004.0 00010000:00010000:1.0:1789127366.325319:0:12098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c024300cfb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.325459:0:12098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c024300cfb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.325468:0:12098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c024300cfb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.325475:0:12098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df798df1e00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:1.0:1789127366.325479:0:12098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c024300cfb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.325487:0:12098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c024300cfb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.325502:0:12098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8df7906f6f00) 00010000:00010000:1.0:1789127366.325505:0:12098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789127366.325510:0:12098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c024300cfb lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.325516:0:12098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c024300cfb lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.325555:0:12098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024300c3e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.325561:0:12098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024300c3e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.325567:0:12098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024300c3e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.325572:0:12098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd96a00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:1.0:1789127366.325575:0:12098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024300c3e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.325581:0:12098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024300c3e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.325588:0:12098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8df782d66800) 00010000:00010000:1.0:1789127366.325590:0:12098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789127366.325598:0:12098:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032dc00/0xeeacf7c024300c45 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c54 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.325608:0:12098:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032dc00/0xeeacf7c024300c45 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c54 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.325619:0:12098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032dc00/0xeeacf7c024300c45 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c54 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.325650:0:12098:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032dc00/0xeeacf7c024300c45 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c54 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127366.325673:0:12098:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7bbd87840 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12098:1876035752764032:192.168.206.40@tcp:105: 00000100:00100000:1.0:1789127366.325964:0:12098:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7907023c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789127366.344181:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127366.344542:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733876736 00000100:00100000:2.0:1789127366.344551:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733876736 00000100:00100000:2.0:1789127366.344600:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 31 00000100:00100000:2.0:1789127366.344609:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79062a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+19:10742:x1876035733876736:12345-192.168.206.40@tcp:49:lfs.0 00000100:00100000:2.0:1789127366.344753:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79062a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+19:10742:x1876035733876736:12345-192.168.206.40@tcp:49:lfs.0 Request processed in 134us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127366.344761:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 31 00000100:00100000:1.0:1789127366.345307:0:12098:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7bbd87840 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12098:1876035752764032:192.168.206.40@tcp:105: 00010000:00010000:1.0:1789127366.345504:0:12098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024300c3e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.345515:0:12098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024300c3e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.345545:0:12098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97a00/0xeeacf7c024300d02 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.345559:0:12098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97a00/0xeeacf7c024300d02 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.345569:0:12098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97a00/0xeeacf7c024300d02 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.345578:0:12098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97a00/0xeeacf7c024300d02 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.345584:0:12098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97a00/0xeeacf7c024300d02 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.345590:0:12098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97a00/0xeeacf7c024300d02 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.345596:0:12098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd97a00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:1.0:1789127366.345600:0:12098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97a00/0xeeacf7c024300d02 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.345621:0:12098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97a00/0xeeacf7c024300d02 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.345633:0:12098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8df782d66800) 00010000:00010000:1.0:1789127366.345636:0:12098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789127366.345639:0:12098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97a00/0xeeacf7c024300d02 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.345644:0:12098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97a00/0xeeacf7c024300d02 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.345654:0:12098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024300cf4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.345660:0:12098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024300cf4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.345665:0:12098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024300cf4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.345670:0:12098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df798df0200 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:1.0:1789127366.345672:0:12098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024300cf4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.345679:0:12098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024300cf4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.345686:0:12098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8df782d66800) 00010000:00010000:1.0:1789127366.345688:0:12098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789127366.345691:0:12098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024300cf4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.345708:0:12098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024300cf4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127366.346238:0:12098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae918f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+18:10743:x1876035733876480:12345-192.168.206.40@tcp:57:lhsmtool_posix.0 Request processed in 45650us (45956us total) trans 4294967407 rc 0/0 00000100:00100000:1.0:1789127366.346249:0:12098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 127 00000020:00080000:1.0:1789127366.346254:0:12098:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789127366.346436:0:12084:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789127366.346442:0:12084:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789127366.347758:0:12084:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1789127366.347771:0:12084:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789127366.361043:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127366.361087:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127366.361252:0:10285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733876992 00000100:00100000:2.0:1789127366.361261:0:10285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733876992 00000100:00100000:2.0:1789127366.361320:0:10285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 128 00000100:00100000:2.0:1789127366.361360:0:10285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bfc4a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+18:10742:x1876035733876992:12345-192.168.206.40@tcp:58:lfs.0 00000040:00080000:2.0:1789127366.361709:0:10285:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:2.0:1789127366.361844:0:10285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bfc4a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+18:10742:x1876035733876992:12345-192.168.206.40@tcp:58:lfs.0 Request processed in 485us (808us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127366.361852:0:10285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 128 00000100:00100000:3.0:1789127366.362249:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733877248 00000100:00100000:3.0:1789127366.362255:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733877248 00000100:00100000:3.0:1789127366.362295:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 32 00000100:00100000:3.0:1789127366.362303:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df791569850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+18:10743:x1876035733877248:12345-192.168.206.40@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789127366.363174:0:5833:0:(mdd_object.c:4024:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789127366.363275:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967408 00010000:00010000:3.0:1789127366.363319:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1000/0xeeacf7c024300d09 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127366.363878:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1000/0xeeacf7c024300d09 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127366.363892:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1000/0xeeacf7c024300d09 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127366.363900:0:5833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1000/0xeeacf7c024300d09 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127366.363918:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1000/0xeeacf7c024300d09 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127366.363923:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1000/0xeeacf7c024300d09 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127366.363942:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789127366.364299:0:8511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789127366.364306:0:8511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1000/0xeeacf7c024300d09 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127366.364313:0:8511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df798df1000 already unused, calling callback (ffffffffc17a4550) 00010000:00010000:0.0:1789127366.364317:0:8511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1000/0xeeacf7c024300d09 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127366.364325:0:8511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1000/0xeeacf7c024300d09 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127366.364353:0:8511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8df79f06c200) 00010000:00010000:0.0:1789127366.364356:0:8511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789127366.364361:0:8511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1000/0xeeacf7c024300d09 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127366.364366:0:8511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1000/0xeeacf7c024300d09 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127366.364383:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127366.364385:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127366.364387:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127366.364560:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df791569850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+20:10743:x1876035733877248:12345-192.168.206.40@tcp:35:lhsmtool_posix.0 Request processed in 2253us (3467us total) trans 4294967409 rc 0/0 00000100:00100000:3.0:1789127366.364570:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 32 00000020:00080000:3.0:1789127366.364576:0:5833:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789127366.410271:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127366.410374:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733877376 00000100:00100000:1.0:1789127366.410383:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733877376 00000100:00100000:1.0:1789127366.410451:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 129 00000100:00100000:1.0:1789127366.410462:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79a2c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+20:10745:x1876035733877376:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:1.0:1789127366.410486:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127366.410508:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97a00/0xeeacf7c024300d10 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7c8c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.410569:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024300d17 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.410585:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024300d17 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.410595:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024300d17 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.410610:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024300d1e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.410616:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024300d1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.410639:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024300d1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.411265:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c024300d25 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.411279:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024300c30 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c4d expref: 21 pid: 10285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.411288:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c024300d25 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.411320:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024300c30 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c4d expref: 21 pid: 10285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.411333:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024300c30 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c4d expref: 21 pid: 10285 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127366.411347:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7bbd87840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5831:1876035752764160:192.168.206.40@tcp:104: 00000100:00100000:1.0:1789127366.411480:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7907023c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789127366.424619:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127366.427015:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733877632 00000100:00100000:3.0:1789127366.427028:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733877632 00000100:00100000:3.0:1789127366.427105:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 33 00000100:00100000:3.0:1789127366.427114:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae2f9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+22:5587:x1876035733877632:12345-192.168.206.40@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789127366.427343:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae2f9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+23:5587:x1876035733877632:12345-192.168.206.40@tcp:35:ldlm_bl.0 Request processed in 229us (2731us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1789127366.427351:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 33 00000100:00100000:1.0:1789127366.428454:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7bbd87840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5831:1876035752764160:192.168.206.40@tcp:104: 00010000:00010000:1.0:1789127366.428481:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c024300d25 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127366.434012:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127366.434161:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733877760 00000100:00100000:2.0:1789127366.434171:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733877760 00010000:00010000:2.0:1789127366.434208:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024300c30 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c4d expref: 23 pid: 10285 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127366.434250:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 66 00000100:00100000:2.0:1789127366.434259:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79a2c5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+23:2349:x1876035733877760:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789127366.434274:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789127366.434281:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024300c30 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c4d expref: 23 pid: 10285 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127366.434295:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024300c30 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c4d expref: 23 pid: 10285 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127366.434317:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024300c30 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c4d expref: 23 pid: 10285 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127366.434346:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8df782d66800) 00010000:00010000:2.0:1789127366.434352:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c024300d25 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127366.434378:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c024300d25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127366.434385:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c024300d25 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127366.434419:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789127366.434481:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79a2c5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+22:2349:x1876035733877760:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 222us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127366.434489:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 66 00010000:00010000:1.0:1789127366.441349:0:5831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c024300d25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.441367:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c024300d25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789127366.441437:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1789127366.441442:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789127366.441466:0:5831:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c024300d25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.441483:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c024300d25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.441494:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024300d17 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.441500:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024300d17 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.441508:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024300d17 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.441514:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd96a00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:1.0:1789127366.441519:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024300d17 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.441526:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024300d17 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.441541:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8df7906f6b00) 00010000:00010000:1.0:1789127366.441545:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789127366.441549:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024300d17 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.441555:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024300d17 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.441583:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024300d1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.441589:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024300d1e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.441595:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024300d1e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.441600:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd97e00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:1.0:1789127366.441603:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024300d1e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.441608:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024300d1e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.441616:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8df782d66200) 00010000:00010000:1.0:1789127366.441618:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789127366.441621:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024300d1e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.441627:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024300d1e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.441667:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97a00/0xeeacf7c024300d10 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c8c expref: 22 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.441694:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c024300d25 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c8c expref: 21 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127366.441724:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8df782d66800) 00010000:00010000:1.0:1789127366.441726:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789127366.441729:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7bbd96600, rc 0) 00000100:00100000:1.0:1789127366.442055:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79a2c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+21:10745:x1876035733877376:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 31592us (31790us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127366.442065:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 129 00010000:00010000:3.0:1789127367.092028:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789127367.310421:0:12503:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789127367.310431:0:12503:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789127367.310494:0:12503:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1789127367.310501:0:12503:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1789127367.413646:0:12084:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789127367.413657:0:12084:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789127367.413718:0:12084:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1789127367.413724:0:12084:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789127367.413889:0:12084:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df68325cf00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12084:1876035752764288:192.168.206.40@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789127367.413979:0:12084:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7ae191b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789127367.425032:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127367.425074:0:12098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733877888 00000100:00100000:0.0:1789127367.425083:0:12098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733877888 00000100:00100000:0.0:1789127367.425137:0:12098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 130 00000100:00100000:0.0:1789127367.425148:0:12098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7af5cd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+22:10757:x1876035733877888:12345-192.168.206.40@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789127367.425183:0:12098:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789127367.425284:0:12098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7af5cd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+22:10757:x1876035733877888:12345-192.168.206.40@tcp:53:lhsmtool_posix.0 Request processed in 138us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127367.425293:0:12098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 130 00000100:00100000:3.0:1789127367.426394:0:12084:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df68325cf00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12084:1876035752764288:192.168.206.40@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789127367.427942:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127367.428055:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733878144 00000100:00100000:3.0:1789127367.428064:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733878144 00000100:00100000:3.0:1789127367.428117:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 131 00000100:00100000:3.0:1789127367.428141:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae2fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+21:10757:x1876035733878144:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789127367.428160:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127367.428180:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0e00/0xeeacf7c024300d2c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7c93 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127367.428270:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024300d33 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127367.428286:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024300d33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127367.428296:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024300d33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789127367.428306:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1789127367.428415:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0e00/0xeeacf7c024300d2c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c93 expref: 24 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127367.428434:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024300d33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c93 expref: 23 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127367.428443:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8df782d66800) 00010000:00010000:3.0:1789127367.428446:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789127367.428450:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df798df1c00, rc 0) 00000100:00100000:3.0:1789127367.428510:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae2fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+23:10757:x1876035733878144:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 Request processed in 371us (574us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1789127367.428519:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 131 00000100:00100000:0.0:1789127367.438384:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127367.438413:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127367.438441:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733878528 00000100:00100000:0.0:1789127367.438450:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733878528 00000100:00100000:0.0:1789127367.438497:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 132 00000100:00100000:0.0:1789127367.438506:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7af5cfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+23:10757:x1876035733878528:12345-192.168.206.40@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789127367.438579:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728600/0xeeacf7c024300d41 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127367.438594:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728600/0xeeacf7c024300d41 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127367.438606:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728600/0xeeacf7c024300d41 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127367.438829:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728600/0xeeacf7c024300d41 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127367.438849:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728600/0xeeacf7c024300d41 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127367.438857:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728600/0xeeacf7c024300d41 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127367.438863:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7ae728600 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:0.0:1789127367.438867:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728600/0xeeacf7c024300d41 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127367.438875:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728600/0xeeacf7c024300d41 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127367.438886:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8df782d66800) 00010000:00010000:0.0:1789127367.438889:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789127367.438894:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728600/0xeeacf7c024300d41 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127367.438899:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728600/0xeeacf7c024300d41 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127367.439040:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7af5cfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+24:10757:x1876035733878528:12345-192.168.206.40@tcp:57:lhsmtool_posix.0 Request processed in 533us (624us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1789127367.439050:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 132 00000040:00080000:0.0:1789127367.439160:0:12084:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789127367.439165:0:12084:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789127367.439657:0:12084:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1789127367.439665:0:12084:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789127367.440246:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733878272 00000100:00100000:1.0:1789127367.440255:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733878272 00000100:00100000:1.0:1789127367.440311:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 8 00000100:00100000:1.0:1789127367.440320:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7af5cc780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+24:2346:x1876035733878272:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789127367.440333:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789127367.440352:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024300d33 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c93 expref: 24 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127367.440365:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8df782d66800) 00010000:00010000:1.0:1789127367.440369:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789127367.440409:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7af5cc780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+23:2346:x1876035733878272:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 91us (2034us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127367.440416:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 8 00000100:00100000:0.0:1789127367.442380:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127367.442442:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733878784 00000100:00100000:3.0:1789127367.442450:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733878784 00000100:00100000:3.0:1789127367.442507:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 34 00000100:00100000:3.0:1789127367.442517:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df682e71e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+23:10757:x1876035733878784:12345-192.168.206.40@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789127367.442756:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df682e71e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+24:10757:x1876035733878784:12345-192.168.206.40@tcp:35:lhsmtool_posix.0 Request processed in 239us (384us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1789127367.442764:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 34 00010000:00010000:2.0:1789127368.114932:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127369.139027:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789127369.203150:0:8062:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 315359358901ns, next at 316359356904ns, rc = 0 00000100:00100000:1.0:1789127369.203349:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae2f8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3301:1876035752764416:0@lo:400:kworker.0 00000100:00100000:1.0:1789127369.203418:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127369.203486:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7aeabb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1876035752764928:0@lo:400:kworker.0 00000100:00100000:1.0:1789127369.203514:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127369.203660:0:10285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752764928 00000100:00100000:3.0:1789127369.203678:0:10285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752764928 00000100:00100000:3.0:1789127369.203895:0:10285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789127369.203906:0:10285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df68325f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876035752764928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127369.203957:0:10285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df68325f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876035752764928:12345-0@lo:400:kworker.0 Request processed in 53us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127369.203965:0:10285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00080000:3.0:1789127369.203986:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789127369.204067:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7aeabb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1876035752764928:0@lo:400:kworker.0 00000100:00100000:1.0:1789127369.204087:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789127369.204094:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7bbd87840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1876035752764800:0@lo:400:kworker.0 00000100:00100000:1.0:1789127369.204122:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127369.204159:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae2f8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876035752764544:0@lo:400:kworker.0 00000100:00100000:1.0:1789127369.204183:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127369.204202:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7aeaba580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752765056:0@lo:400:kworker.0 00000100:00100000:1.0:1789127369.204224:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127369.204244:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789127369.204250:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae2f9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1876035752764672:0@lo:400:kworker.0 00000100:00100000:1.0:1789127369.204273:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127369.204290:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7b43321c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752765184:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789127369.204313:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127369.204339:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752764544 00000100:00100000:1.0:1789127369.204343:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752764544 00000100:00100000:1.0:1789127369.204365:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752764672 00000100:00100000:1.0:1789127369.204368:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752764672 00000100:00100000:1.0:1789127369.204388:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789127369.204394:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df68325d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876035752764544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127369.204429:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df68325d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876035752764544:12345-0@lo:400:kworker.0 Request processed in 35us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127369.204453:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789127369.204467:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789127369.204473:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df68325da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876035752764672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127369.204502:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df68325da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876035752764672:12345-0@lo:400:kworker.0 Request processed in 30us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127369.204507:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789127369.204524:0:8063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752764800 00000100:00100000:1.0:1789127369.204527:0:8063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752764800 00000100:00100000:0.0:1789127369.204693:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752765184 00000100:00100000:0.0:1789127369.204705:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752765184 00000100:00100000:0.0:1789127369.204743:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789127369.204751:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df68325c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1876035752765184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789127369.204777:0:10333:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789127369.204836:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df68325c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1876035752765184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127369.204842:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:0.0:1789127369.204874:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789127369.204877:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789127369.204901:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae2f9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1876035752764672:0@lo:400:kworker.0 00000100:00100000:0.0:1789127369.204915:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7b43321c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752765184:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789127369.204924:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae2f8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876035752764544:0@lo:400:kworker.0 00000100:00100000:3.0:1789127369.205143:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752765056 00000100:00100000:3.0:1789127369.205148:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752765056 00000100:00100000:3.0:1789127369.205185:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789127369.205193:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df68325de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3302:x1876035752765056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127369.205237:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df68325de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3302:x1876035752765056:12345-0@lo:400:kworker.0 Request processed in 45us (1011us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127369.205243:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789127369.205275:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7aeaba580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752765056:0@lo:400:kworker.0 00000100:00100000:2.0:1789127369.205360:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752764416 00000100:00100000:2.0:1789127369.205365:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752764416 00000100:00100000:2.0:1789127369.205394:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1789127369.205401:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df787bb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:3301:x1876035752764416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127369.205449:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df787bb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:3301:x1876035752764416:12345-0@lo:400:kworker.0 Request processed in 49us (2031us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127369.205455:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1789127369.207134:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae2f8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3301:1876035752764416:0@lo:400:kworker.0 00000100:00080000:0.0:1789127369.207448:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789127369.207499:0:8063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789127369.207509:0:8063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df68325e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3301:x1876035752764800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127369.207608:0:8063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df68325e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3301:x1876035752764800:12345-0@lo:400:kworker.0 Request processed in 101us (3485us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127369.207616:0:8063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789127369.208042:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7bbd87840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1876035752764800:0@lo:400:kworker.0 00000040:00080000:1.0:1789127369.387653:0:12554:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789127369.387662:0:12554:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789127369.387857:0:12554:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1789127369.387864:0:12554:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789127369.612223:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127369.612302:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733879040 00000100:00100000:3.0:1789127369.612312:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733879040 00000100:00100000:3.0:1789127369.612417:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 133 00000100:00100000:3.0:1789127369.612426:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df682e71a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+24:10777:x1876035733879040:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:3.0:1789127369.612459:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127369.612490:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0e00/0xeeacf7c024300d48 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7c9a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127369.612580:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1000/0xeeacf7c024300d4f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127369.612595:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1000/0xeeacf7c024300d4f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127369.612605:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1000/0xeeacf7c024300d4f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789127369.612615:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1789127369.612899:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0e00/0xeeacf7c024300d48 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c9a expref: 27 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127369.612922:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1000/0xeeacf7c024300d4f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c9a expref: 26 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127369.612931:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8df782d66800) 00010000:00010000:3.0:1789127369.612934:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789127369.612938:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df798df1000, rc 0) 00000100:00100000:3.0:1789127369.612999:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df682e71a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+26:10777:x1876035733879040:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 574us (786us total) trans 4294967414 rc 0/0 00000100:00100000:3.0:1789127369.613007:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 133 00000100:00100000:3.0:1789127369.617053:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127369.617218:0:12098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733879168 00000100:00100000:2.0:1789127369.617229:0:12098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733879168 00000100:00100000:2.0:1789127369.617288:0:12098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 134 00000100:00100000:2.0:1789127369.617297:0:12098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b43321c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+26:10777:x1876035733879168:12345-192.168.206.40@tcp:54:lfs.0 00010000:00010000:2.0:1789127369.617362:0:12098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032da00/0xeeacf7c024300d5d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127369.617394:0:12098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032da00/0xeeacf7c024300d5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127369.617406:0:12098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032da00/0xeeacf7c024300d5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127369.617432:0:12098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032da00/0xeeacf7c024300d5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127369.617438:0:12098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032da00/0xeeacf7c024300d5d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127369.617445:0:12098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032da00/0xeeacf7c024300d5d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127369.617450:0:12098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df79032da00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:2.0:1789127369.617454:0:12098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032da00/0xeeacf7c024300d5d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127369.617461:0:12098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032da00/0xeeacf7c024300d5d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127369.617471:0:12098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8df782d66800) 00010000:00010000:2.0:1789127369.617474:0:12098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789127369.617478:0:12098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032da00/0xeeacf7c024300d5d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127369.617484:0:12098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032da00/0xeeacf7c024300d5d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127369.617558:0:12098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b43321c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+26:10777:x1876035733879168:12345-192.168.206.40@tcp:54:lfs.0 Request processed in 260us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127369.617570:0:12098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 134 00000100:00080000:0.0:1789127369.619033:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789127369.732330:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127369.732459:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733879296 00000100:00100000:3.0:1789127369.732469:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733879296 00000100:00100000:2.0:1789127369.732749:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 45 00000100:00100000:2.0:1789127369.732760:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeabb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+6:2349:x1876035733879296:12345-192.168.206.40@tcp:101:cat.0 00010000:00010000:2.0:1789127369.732777:0:6686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127369.732841:0:6686:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007b9a4f41/0xeeacf7c024300d64 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7ca1 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789127369.732867:0:6686:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aa3eac4, atime: 0x6aa3eac4, ctime: 0x6aa3eac4, blocks: 0xb 00010000:00010000:2.0:1789127369.732885:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=315s v=(0 0) 00010000:00010000:2.0:1789127369.732889:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127369.732900:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007b9a4f41/0xeeacf7c024300d64 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7ca1 expref: 7 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127369.732920:0:6686:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007b9a4f41/0xeeacf7c024300d64 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7ca1 expref: 7 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127369.732946:0:6686:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df79032da00, rc 0) 00000100:00100000:2.0:1789127369.733002:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeabb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+7:2349:x1876035733879296:12345-192.168.206.40@tcp:101:cat.0 Request processed in 243us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127369.733009:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 45 00000100:00080000:0.0:1789127369.733210:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789127369.737465:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127369.737561:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733879424 00000100:00100000:1.0:1789127369.737571:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733879424 00002000:00100000:1.0:1789127369.737622:0:6694:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff8df682e70000 x1876035733879424/t0(0) o3->28762f98-a240-4662-a754-e28bbeb6cb4b@192.168.206.40@tcp:105/0 lens 488/0 e 0 to 0 dl 1789127380 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789127369.737632:0:6694:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff8df682e70000 with x1876035733879424 ext(0->4095) 00002000:00010000:1.0:1789127369.737638:0:6694:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df682e70000 00000100:00100000:1.0:1789127369.737690:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 3 00000100:00100000:1.0:1789127369.737708:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df682e70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+7:2348:x1876035733879424:12345-192.168.206.40@tcp:3:cat.0 00000100:00100000:1.0:1789127369.737977:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df682e70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+7:2348:x1876035733879424:12345-192.168.206.40@tcp:3:cat.0 Request processed in 277us (518us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1789127369.737985:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 3 00002000:00100000:1.0:1789127369.737992:0:6694:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff8df682e70000 x1876035733879424/t0(0) o3->28762f98-a240-4662-a754-e28bbeb6cb4b@192.168.206.40@tcp:105/0 lens 488/4536 e 0 to 0 dl 1789127380 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789127369.738019:0:6694:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff8df682e70000 with x1876035733879424 ext(0->4095) 00002000:00010000:1.0:1789127369.738023:0:6694:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df682e70000 00000100:00100000:3.0:1789127369.960237:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127369.960282:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127369.960318:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127369.960415:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733879552 00000100:00100000:0.0:1789127369.960423:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733879552 00000100:00100000:0.0:1789127369.960499:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 321 00000100:00100000:0.0:1789127369.960509:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df787bbb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d829a69b-d740-4e4c-8301-ef09c9d45165+13:2347:x1876035733879552:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:0.0:1789127369.960576:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df787bbb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d829a69b-d740-4e4c-8301-ef09c9d45165+13:2347:x1876035733879552:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 68us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127369.960583:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 321 00000100:00100000:2.0:1789127369.962427:0:8063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733879680 00000100:00100000:2.0:1789127369.962438:0:8063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733879680 00000100:00100000:2.0:1789127369.962526:0:8063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 73 00000100:00100000:2.0:1789127369.962535:0:8063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df78efcf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+7:2347:x1876035733879680:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:2.0:1789127369.962612:0:8063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df78efcf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+7:2347:x1876035733879680:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 78us (2291us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127369.962619:0:8063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 73 00000100:00100000:1.0:1789127369.963305:0:10285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733879808 00000100:00100000:1.0:1789127369.963312:0:10285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733879808 00000100:00080000:0.0:1789127369.963346:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789127369.963352:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789127369.963361:0:10285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 147 00000100:00100000:1.0:1789127369.963371:0:10285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b4333c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81b0e267-d7e0-4043-b34e-eec2dc4c5a6b+5:2347:x1876035733879808:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:1.0:1789127369.963434:0:10285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b4333c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81b0e267-d7e0-4043-b34e-eec2dc4c5a6b+5:2347:x1876035733879808:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 64us (3149us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127369.963442:0:10285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 147 00010000:00010000:3.0:1789127370.163274:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127370.229611:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789127370.229632:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79062a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1876035752765312:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789127370.229716:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127370.229904:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752765312 00000100:00100000:3.0:1789127370.229911:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752765312 00000100:00100000:3.0:1789127370.229972:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789127370.229982:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeaba580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3301:x1876035752765312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789127370.230011:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789127370.230055:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeaba580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3301:x1876035752765312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127370.230062:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789127370.230396:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79062a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1876035752765312:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1789127370.291305:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:0.0:1789127370.291321:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:0.0:1789127370.291327:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00010000:00010000:2.0:1789127371.187078:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789127371.353149:0:7646:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:2.0:1789127371.353162:0:7646:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:1.0:1789127371.369442:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967412 is committed 00000020:00080000:1.0:1789127371.369464:0:5852:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8df7aeaafb40 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1789127371.369469:0:5852:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8df7aeb01300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8df7aeaaf9c0 00000020:00080000:1.0:1789127371.369472:0:5852:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8df7aeb01100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8df7aea71c00 00000001:00080000:1.0:1789127371.369497:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000004:00080000:1.0:1789127371.369505:0:5852:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:1.0:1789127371.369538:0:5852:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:2.0:1789127371.369578:0:5863:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:2.0:1789127371.369828:0:5863:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:2.0:1789127371.370051:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df787b8e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1876035752765440:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789127371.370117:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127371.370195:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752765440 00000100:00100000:2.0:1789127371.370201:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752765440 00000100:00100000:2.0:1789127371.370251:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789127371.370380:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeb17840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1876035752765440:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1789127371.370556:0:6689:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1789127371.370560:0:6689:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1789127364 -> 1789127364 00002000:00010000:2.0:1789127371.370562:0:6689:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 1789127364 -> 1789127364 00002000:00010000:2.0:1789127371.370565:0:6689:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1789127364 -> 1789127364 00002000:00010000:2.0:1789127371.370567:0:6689:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1789127371.370609:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeb17840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3301:x1876035752765440:12345-0@lo:2:osp-syn-1-0.0 Request processed in 350us (491us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1789127371.370617:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:2.0:1789127371.370652:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789127371.370695:0:3301:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:2.0:1789127371.370701:0:3301:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967311 committed transno 4294967311 00000100:00100000:2.0:1789127371.370730:0:3301:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8df787b8e940 x1876035752765440/t4294967312(4294967312) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1789127387 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1789127371.370742:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8df787b8e940/2, rc 0, transno 4294967312 00000100:00100000:2.0:1789127371.370747:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df787b8e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1876035752765440:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1789127372.211857:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127373.235515:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127374.261926:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127374.323187:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df682e72580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1876035752765952:0@lo:400:kworker.0 00000100:00100000:0.0:1789127374.323258:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127374.323313:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789127374.323319:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df682e70780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1876035752765824:0@lo:400:kworker.0 00000100:00100000:0.0:1789127374.323346:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127374.323381:0:8063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752765952 00000100:00100000:0.0:1789127374.323388:0:8063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752765952 00000100:00100000:0.0:1789127374.323440:0:8063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789127374.323449:0:8063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df682e72d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1876035752765952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127374.323495:0:8063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df682e72d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1876035752765952:12345-0@lo:400:kworker.0 Request processed in 48us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127374.323502:0:8063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:0.0:1789127374.323522:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789127374.323545:0:3301:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:0.0:1789127374.323552:0:3301:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:0.0:1789127374.323583:0:3301:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8df7aeaba940, transno 4294967304 00000100:00100000:0.0:1789127374.323596:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df682e72580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1876035752765952:0@lo:400:kworker.0 00000100:00100000:1.0:1789127374.323871:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df682e72940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3302:1876035752765568:0@lo:400:kworker.0 00000100:00100000:1.0:1789127374.323907:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127374.323935:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df682e73840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1876035752766080:0@lo:400:kworker.0 00000100:00100000:1.0:1789127374.323957:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127374.323979:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789127374.323985:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df682e71680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876035752765696:0@lo:400:kworker.0 00000100:00100000:1.0:1789127374.324005:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127374.324023:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df682e70b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752766208:0@lo:400:kworker.0 00000100:00100000:1.0:1789127374.324054:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127374.324087:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752765824 00000100:00100000:1.0:1789127374.324091:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752765824 00000100:00100000:1.0:1789127374.324122:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752766080 00000100:00100000:1.0:1789127374.324126:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752766080 00000100:00100000:1.0:1789127374.324141:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752765696 00000100:00100000:1.0:1789127374.324144:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752765696 00000100:00100000:1.0:1789127374.324159:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789127374.324166:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df682e730c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876035752765824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127374.324206:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df682e730c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876035752765824:12345-0@lo:400:kworker.0 Request processed in 40us (858us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127374.324212:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789127374.324226:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789127374.324232:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df68325c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876035752766080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127374.324262:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df68325c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876035752766080:12345-0@lo:400:kworker.0 Request processed in 31us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127374.324269:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789127374.324279:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789127374.324285:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df68325e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876035752765696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127374.324311:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df68325e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876035752765696:12345-0@lo:400:kworker.0 Request processed in 27us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127374.324317:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789127374.324633:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752766208 00000100:00100000:1.0:1789127374.324637:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752766208 00000100:00100000:1.0:1789127374.324666:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789127374.324673:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df68325d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3302:x1876035752766208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127374.324720:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df68325d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3302:x1876035752766208:12345-0@lo:400:kworker.0 Request processed in 47us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127374.324732:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:1.0:1789127374.324749:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789127374.324753:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789127374.324781:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df682e70780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1876035752765824:0@lo:400:kworker.0 00000100:00100000:1.0:1789127374.324831:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df682e71680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876035752765696:0@lo:400:kworker.0 00000100:00100000:1.0:1789127374.324842:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df682e70b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752766208:0@lo:400:kworker.0 00000100:00100000:1.0:1789127374.324851:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df682e73840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1876035752766080:0@lo:400:kworker.0 00000100:00100000:0.0:1789127374.326321:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752765568 00000100:00100000:0.0:1789127374.326334:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752765568 00000100:00100000:0.0:1789127374.326390:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1789127374.326399:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df787bb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:3302:x1876035752765568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127374.326472:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df787bb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:3302:x1876035752765568:12345-0@lo:400:kworker.0 Request processed in 75us (2564us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127374.326479:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1789127374.326523:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df682e72940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3302:1876035752765568:0@lo:400:kworker.0 00000100:00100000:0.0:1789127374.328397:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789127374.328415:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79062a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1876035752766336:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789127374.328468:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127374.331081:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752766336 00000100:00100000:3.0:1789127374.331094:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752766336 00000100:00100000:3.0:1789127374.331158:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789127374.331168:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df682e72940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1876035752766336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789127374.331205:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789127374.331299:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df682e72940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1876035752766336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 132us (2829us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127374.331306:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789127374.331405:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79062a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1876035752766336:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789127374.857718:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127374.857851:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733879936 00000100:00100000:1.0:1789127374.857874:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733879936 00000100:00100000:1.0:1789127374.857951:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 135 00000100:00100000:1.0:1789127374.857961:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bbd87840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+13:10422:x1876035733879936:12345-192.168.206.40@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1789127374.858055:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bbd87840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+13:10422:x1876035733879936:12345-192.168.206.40@tcp:60:lhsmtool_posix.0 Request processed in 95us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127374.858063:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 135 00000100:00080000:2.0:1789127374.858458:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789127374.870628:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127374.880161:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733880192 00000100:00100000:2.0:1789127374.880179:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733880192 00000100:00100000:2.0:1789127374.880246:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 35 00000100:00100000:2.0:1789127374.880259:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df682e72580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+13:10422:x1876035733880192:12345-192.168.206.40@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789127374.880859:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df682e72580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+14:10422:x1876035733880192:12345-192.168.206.40@tcp:35:lhsmtool_posix.0 Request processed in 601us (10237us total) trans 4294967415 rc 0/0 00000100:00100000:2.0:1789127374.881113:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 35 00000100:00100000:1.0:1789127375.093664:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127375.093731:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127375.093785:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127375.093857:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127375.093859:0:10285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733880448 00000100:00100000:2.0:1789127375.093869:0:10285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733880448 00000100:00100000:1.0:1789127375.093905:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127375.094042:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733880320 00000100:00100000:3.0:1789127375.094047:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733880320 00000100:00100000:3.0:1789127375.094078:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 323 00000100:00100000:3.0:1789127375.094087:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df787bb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d829a69b-d740-4e4c-8301-ef09c9d45165+13:2347:x1876035733880320:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:0.0:1789127375.094513:0:8063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733880704 00000100:00100000:0.0:1789127375.094518:0:8063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733880704 00000100:00100000:0.0:1789127375.094553:0:8063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733880576 00000100:00100000:0.0:1789127375.094555:0:8063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733880576 00000100:00100000:0.0:1789127375.094573:0:8063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 76 00000100:00100000:0.0:1789127375.094580:0:8063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df68325e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+6:2347:x1876035733880704:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:0.0:1789127375.094622:0:8063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df68325e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+6:2347:x1876035733880704:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 42us (890us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127375.094629:0:8063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 76 00000100:00100000:0.0:1789127375.094646:0:8063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 77 00000100:00100000:0.0:1789127375.094652:0:8063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df68325f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+5:2347:x1876035733880576:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:0.0:1789127375.094703:0:8063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df68325f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+5:2347:x1876035733880576:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 40us (837us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127375.094710:0:8063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 77 00000100:00100000:3.0:1789127375.097811:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df787bb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d829a69b-d740-4e4c-8301-ef09c9d45165+13:2347:x1876035733880320:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 3699us (4009us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127375.097845:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 323 00000100:00080000:3.0:1789127375.098088:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789127375.098093:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789127375.110255:0:10285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733880832 00000100:00100000:2.0:1789127375.110269:0:10285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733880832 00000100:00100000:2.0:1789127375.110351:0:10285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 151 00000100:00100000:2.0:1789127375.110361:0:10285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df68325c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+14:2347:x1876035733880448:12345-192.168.206.40@tcp:400:kworker.0 00000100:00080000:1.0:1789127375.110612:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789127375.110646:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 152 00000100:00100000:1.0:1789127375.110657:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df68325cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81b0e267-d7e0-4043-b34e-eec2dc4c5a6b+5:2347:x1876035733880832:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:1.0:1789127375.110716:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df68325cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81b0e267-d7e0-4043-b34e-eec2dc4c5a6b+5:2347:x1876035733880832:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 61us (16810us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127375.110723:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 152 00000100:00100000:2.0:1789127375.111393:0:10285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df68325c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+14:2347:x1876035733880448:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 85us (16789us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127375.111403:0:10285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 151 00000100:00100000:0.0:1789127375.116870:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127375.116963:0:12098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733880960 00000100:00100000:1.0:1789127375.116973:0:12098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733880960 00000100:00100000:1.0:1789127375.117084:0:12098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 136 00000100:00100000:1.0:1789127375.117097:0:12098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df682e73c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81b0e267-d7e0-4043-b34e-eec2dc4c5a6b+5:11229:x1876035733880960:12345-192.168.206.40@tcp:101:lsof.0 00010000:00010000:1.0:1789127375.117117:0:12098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127375.117151:0:12098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c024300d6b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7ca8 expref: -99 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127375.117214:0:12098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c024300d72 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127375.117230:0:12098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c024300d72 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127375.117245:0:12098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c024300d72 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789127375.117453:0:12098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1789127375.117458:0:12098:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1789127375.120851:0:12098:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c024300d72 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127375.120905:0:12098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c024300d6b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7ca8 expref: 7 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127375.120925:0:12098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c024300d72 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7ca8 expref: 6 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127375.120942:0:12098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df782d66900) 00010000:00010000:1.0:1789127375.120945:0:12098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789127375.120948:0:12098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7bbd97800, rc 0) 00000100:00100000:1.0:1789127375.121016:0:12098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df682e73c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81b0e267-d7e0-4043-b34e-eec2dc4c5a6b+6:11229:x1876035733880960:12345-192.168.206.40@tcp:101:lsof.0 Request processed in 3920us (4154us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127375.121025:0:12098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 136 00010000:00010000:0.0:1789127375.283654:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127375.347155:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789127375.347187:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79062a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1876035752766464:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789127375.348153:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127375.350049:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752766464 00000100:00100000:2.0:1789127375.350085:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752766464 00000100:00100000:2.0:1789127375.350164:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789127375.350176:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bb93fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876035752766464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789127375.350226:0:10333:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789127375.350436:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79062a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1876035752766464:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789127375.350950:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bb93fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876035752766464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 772us (2797us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127375.350962:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000040:00080000:1.0:1789127375.667176:0:12084:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789127375.667186:0:12084:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789127375.667524:0:12084:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:1.0:1789127375.667531:0:12084:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1789127376.307162:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789127376.476453:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:1.0:1789127376.476466:0:5852:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:2.0:1789127376.476729:0:5863:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:2.0:1789127376.476739:0:5863:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000001:00080000:2.0:1789127376.506544:0:7646:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00010000:00010000:0.0:1789127377.331073:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127378.356235:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789127378.649751:0:12760:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 07:49:36 (1789127376) 00010000:00010000:3.0:1789127379.379046:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127379.443081:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789127379.443102:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79062b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1876035752766592:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789127379.443171:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127379.443319:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752766592 00000100:00100000:3.0:1789127379.443327:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752766592 00000100:00100000:3.0:1789127379.443401:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789127379.443411:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bbd87c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876035752766592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789127379.443459:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789127379.443506:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bbd87c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876035752766592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127379.443513:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:1.0:1789127379.443763:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789127379.443842:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:2.0:1789127379.443848:0:3303:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8df787b8e940, transno 4294967312 00000100:00100000:2.0:1789127379.443872:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79062b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1876035752766592:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789127379.444776:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df790629680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876035752766848:0@lo:400:kworker.0 00000100:00100000:1.0:1789127379.444846:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127379.444916:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df790628b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3303:1876035752766720:0@lo:400:kworker.0 00000100:00100000:2.0:1789127379.444947:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127379.445001:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752766848 00000100:00100000:2.0:1789127379.445006:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752766848 00000100:00100000:2.0:1789127379.445044:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789127379.445052:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df68325f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876035752766848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127379.445189:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752766720 00000100:00100000:0.0:1789127379.445194:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752766720 00000100:00100000:0.0:1789127379.445222:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1789127379.445228:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df787bb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:3303:x1876035752766720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127379.445267:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df787bb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:3303:x1876035752766720:12345-0@lo:400:kworker.0 Request processed in 39us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127379.445273:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1789127379.445312:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df790629a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1876035752766976:0@lo:400:kworker.0 00000100:00100000:0.0:1789127379.445338:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127379.445390:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752766976 00000100:00100000:0.0:1789127379.445394:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752766976 00000100:00100000:0.0:1789127379.445424:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789127379.445450:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df682e70f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876035752766976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127379.445499:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df682e70f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876035752766976:12345-0@lo:400:kworker.0 Request processed in 69us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127379.445505:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789127379.445541:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df790629a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1876035752766976:0@lo:400:kworker.0 00000100:00080000:0.0:1789127379.445565:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789127379.445588:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df790628b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3303:1876035752766720:0@lo:400:kworker.0 00000100:00100000:2.0:1789127379.448660:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df68325f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876035752766848:12345-0@lo:400:kworker.0 Request processed in 3599us (3804us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127379.448683:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789127379.449763:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7906292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752767104:0@lo:400:kworker.0 00000100:00100000:0.0:1789127379.449858:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127379.449892:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789127379.449898:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79062a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1876035752767232:0@lo:400:kworker.0 00000100:00100000:0.0:1789127379.449925:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127379.449979:0:12098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752767232 00000100:00100000:0.0:1789127379.449985:0:12098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752767232 00000100:00100000:0.0:1789127379.450039:0:12098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789127379.450048:0:12098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df682e721c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876035752767232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127379.450095:0:12098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df682e721c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876035752767232:12345-0@lo:400:kworker.0 Request processed in 48us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127379.450102:0:12098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00080000:0.0:1789127379.450121:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789127379.450153:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79062a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1876035752767232:0@lo:400:kworker.0 00000100:00100000:3.0:1789127379.450357:0:8063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752767104 00000100:00100000:3.0:1789127379.450362:0:8063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752767104 00000100:00100000:3.0:1789127379.450423:0:8063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00080000:0.0:1789127379.450707:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789127379.450735:0:8063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df682e73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1876035752767104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127379.450820:0:8063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df682e73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1876035752767104:12345-0@lo:400:kworker.0 Request processed in 389us (962us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127379.450828:0:8063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789127379.450927:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7906292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752767104:0@lo:400:kworker.0 00000100:00100000:1.0:1789127379.451745:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df790629680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876035752766848:0@lo:400:kworker.0 00000100:00100000:1.0:1789127379.706200:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127379.706306:0:10285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733881216 00000100:00100000:0.0:1789127379.706317:0:10285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733881216 00000100:00080000:2.0:1789127379.706471:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789127379.706646:0:10285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 137 00000100:00100000:0.0:1789127379.706664:0:10285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df68325fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+13:11494:x1876035733881216:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789127379.706708:0:10285:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127379.706730:0:10285:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729000/0xeeacf7c024300d79 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7caf expref: -99 pid: 10285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127379.706830:0:10285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729200/0xeeacf7c024300d80 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127379.706846:0:10285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729200/0xeeacf7c024300d80 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127379.706858:0:10285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729200/0xeeacf7c024300d80 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127379.706872:0:10285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728a00/0xeeacf7c024300d87 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127379.706880:0:10285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728a00/0xeeacf7c024300d87 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127379.706887:0:10285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728a00/0xeeacf7c024300d87 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127379.707316:0:10285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729400/0xeeacf7c024300d8e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127379.707327:0:10285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729400/0xeeacf7c024300d8e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127379.707335:0:10285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729400/0xeeacf7c024300d8e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789127379.707355:0:10285:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1789127379.708025:0:10285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729200/0xeeacf7c024300d80 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127379.708036:0:10285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729200/0xeeacf7c024300d80 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127379.708042:0:10285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729200/0xeeacf7c024300d80 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127379.708048:0:10285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7ae729200 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:0.0:1789127379.708052:0:10285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729200/0xeeacf7c024300d80 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127379.708058:0:10285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729200/0xeeacf7c024300d80 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127379.708071:0:10285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8df782d66a00) 00010000:00010000:0.0:1789127379.708074:0:10285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127379.708079:0:10285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729200/0xeeacf7c024300d80 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127379.708085:0:10285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729200/0xeeacf7c024300d80 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127379.708097:0:10285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728a00/0xeeacf7c024300d87 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127379.708103:0:10285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728a00/0xeeacf7c024300d87 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127379.708121:0:10285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728a00/0xeeacf7c024300d87 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127379.708126:0:10285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7ae728a00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:0.0:1789127379.708129:0:10285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728a00/0xeeacf7c024300d87 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127379.708136:0:10285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728a00/0xeeacf7c024300d87 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127379.708144:0:10285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8df782a68000) 00010000:00010000:0.0:1789127379.708147:0:10285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127379.708150:0:10285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728a00/0xeeacf7c024300d87 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127379.708155:0:10285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728a00/0xeeacf7c024300d87 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127379.708926:0:10285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729000/0xeeacf7c024300d79 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7caf expref: 16 pid: 10285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127379.708945:0:10285:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729400/0xeeacf7c024300d8e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7caf expref: 15 pid: 10285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127379.708954:0:10285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8df79f06c900) 00010000:00010000:0.0:1789127379.708956:0:10285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127379.708960:0:10285:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7ae729400, rc 0) 00000100:00100000:0.0:1789127379.709291:0:10285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df68325fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+15:11494:x1876035733881216:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 Request processed in 2628us (3097us total) trans 4294967416 rc 0/0 00000100:00100000:0.0:1789127379.709312:0:10285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 137 00000100:00100000:0.0:1789127379.716627:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127379.716684:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127379.716857:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733881344 00000100:00100000:3.0:1789127379.716865:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733881472 00000100:00100000:2.0:1789127379.716867:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733881344 00000100:00100000:3.0:1789127379.716873:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733881472 00000100:00100000:2.0:1789127379.716925:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 138 00000100:00100000:3.0:1789127379.716936:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 9 00000100:00100000:2.0:1789127379.716938:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df682e712c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+16:11494:x1876035733881344:12345-192.168.206.40@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1789127379.716951:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7889cb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+16:2347:x1876035733881472:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789127379.716967:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127379.716992:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729400/0xeeacf7c024300d8e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7caf expref: 16 pid: 10285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127379.717024:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8df79f06c900) 00010000:00010000:3.0:1789127379.717029:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789127379.717041:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df682e712c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+15:11494:x1876035733881344:12345-192.168.206.40@tcp:59:lhsmtool_posix.0 Request processed in 106us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127379.717051:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 138 00000100:00100000:3.0:1789127379.717058:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7889cb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+15:2347:x1876035733881472:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 110us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127379.717068:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 9 00000040:00080000:2.0:1789127379.763033:0:12084:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789127379.763043:0:12084:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789127379.763078:0:12084:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:2.0:1789127379.763084:0:12084:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789127380.198776:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127380.198835:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127380.198866:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127380.198885:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127380.198909:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127380.198935:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733881728 00000100:00100000:3.0:1789127380.198944:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733881728 00000100:00100000:3.0:1789127380.198989:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733882112 00000100:00100000:3.0:1789127380.198992:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733882112 00000100:00100000:3.0:1789127380.199020:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 156 00000100:00100000:3.0:1789127380.199029:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df790629680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+14:2347:x1876035733881728:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:3.0:1789127380.199101:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df790629680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+14:2347:x1876035733881728:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 73us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127380.199109:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 156 00000100:00100000:3.0:1789127380.199126:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 157 00000100:00100000:3.0:1789127380.199133:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df790628b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81b0e267-d7e0-4043-b34e-eec2dc4c5a6b+6:2347:x1876035733882112:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:3.0:1789127380.199160:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df790628b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81b0e267-d7e0-4043-b34e-eec2dc4c5a6b+6:2347:x1876035733882112:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 27us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127380.199166:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 157 00000100:00100000:3.0:1789127380.199197:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733881984 00000100:00100000:3.0:1789127380.199200:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733881984 00000100:00100000:3.0:1789127380.199224:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733881856 00000100:00100000:3.0:1789127380.199227:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733881856 00000100:00100000:3.0:1789127380.199248:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 79 00000100:00100000:3.0:1789127380.199254:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7906292c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+6:2347:x1876035733881984:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:3.0:1789127380.199283:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7906292c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+6:2347:x1876035733881984:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 29us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127380.199289:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 79 00000100:00100000:3.0:1789127380.199301:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 80 00000100:00100000:3.0:1789127380.199307:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79062a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+5:2347:x1876035733881856:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:3.0:1789127380.199332:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79062a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+5:2347:x1876035733881856:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 25us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127380.199339:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 80 00000100:00100000:3.0:1789127380.199356:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733881600 00000100:00100000:3.0:1789127380.199359:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733881600 00000100:00100000:3.0:1789127380.199384:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 325 00000100:00100000:3.0:1789127380.199390:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df787bb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d829a69b-d740-4e4c-8301-ef09c9d45165+13:2347:x1876035733881600:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:3.0:1789127380.199415:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df787bb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d829a69b-d740-4e4c-8301-ef09c9d45165+13:2347:x1876035733881600:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 25us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127380.199421:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 325 00000100:00080000:2.0:1789127380.200847:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789127380.200857:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789127380.200860:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789127380.406255:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127380.470192:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df790629a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1876035752767360:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789127380.470256:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127380.470334:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752767360 00000100:00100000:3.0:1789127380.470340:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752767360 00000100:00100000:3.0:1789127380.470382:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789127380.470400:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79062b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876035752767360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789127380.470432:0:10333:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789127380.470473:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79062b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876035752767360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127380.470480:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789127380.470538:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df790629a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1876035752767360:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789127381.427641:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127381.555951:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127381.555989:0:12098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733882240 00000100:00100000:1.0:1789127381.555997:0:12098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733882240 00000100:00100000:1.0:1789127381.556060:0:12098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 139 00000100:00100000:1.0:1789127381.556071:0:12098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df68325c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+14:11536:x1876035733882240:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:1.0:1789127381.556091:0:12098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127381.556111:0:12098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c024300d9c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7cb6 expref: -99 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127381.556183:0:12098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024300da3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127381.556198:0:12098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024300da3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127381.556209:0:12098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024300da3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127381.556227:0:12098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96800/0xeeacf7c024300daa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127381.556234:0:12098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96800/0xeeacf7c024300daa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127381.556240:0:12098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96800/0xeeacf7c024300daa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127381.556514:0:12098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024300da3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127381.556523:0:12098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024300da3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127381.556530:0:12098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024300da3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127381.556592:0:12098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd96000 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:1.0:1789127381.556596:0:12098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024300da3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127381.556614:0:12098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024300da3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127381.556705:0:12098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df782d66900) 00010000:00010000:1.0:1789127381.556709:0:12098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789127381.556714:0:12098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024300da3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127381.556721:0:12098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024300da3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127381.556732:0:12098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96800/0xeeacf7c024300daa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127381.556738:0:12098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96800/0xeeacf7c024300daa lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127381.556744:0:12098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96800/0xeeacf7c024300daa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127381.556749:0:12098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd96800 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:1.0:1789127381.556752:0:12098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96800/0xeeacf7c024300daa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127381.556757:0:12098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96800/0xeeacf7c024300daa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127381.556765:0:12098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8df782d66700) 00010000:00010000:1.0:1789127381.556768:0:12098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789127381.556770:0:12098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96800/0xeeacf7c024300daa lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127381.557024:0:12098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96800/0xeeacf7c024300daa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127381.557070:0:12098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c024300d9c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7cb6 expref: 15 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127381.557081:0:12098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df782d66900) 00010000:00010000:1.0:1789127381.557084:0:12098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789127381.557089:0:12098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c024300d9c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7cb6 expref: 15 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127381.557098:0:12098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7bbd97600, rc 0) 00000100:00100000:1.0:1789127381.557156:0:12098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df68325c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+14:11536:x1876035733882240:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 1087us (1214us total) trans 0 rc 301/301 00000100:00100000:1.0:1789127381.557164:0:12098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 139 00000100:00080000:1.0:1789127381.557188:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789127381.563274:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127381.563522:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733882496 00000100:00100000:1.0:1789127381.563541:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733882496 00000100:00100000:1.0:1789127381.563604:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 140 00000100:00100000:1.0:1789127381.563616:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bbd870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+14:11536:x1876035733882496:12345-192.168.206.40@tcp:36:lfs.0 00010000:00010000:1.0:1789127381.563681:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789127381.563707:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96400/0xeeacf7c02430071a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7aef expref: 14 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127381.563723:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df782d66900) 00010000:00010000:1.0:1789127381.563729:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789127381.564830:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c024300db1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127381.564851:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c024300d72 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7ca8 expref: 5 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127381.564861:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c024300db1 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127381.570900:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c024300d72 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7ca8 expref: 5 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127381.570944:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c024300d72 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7ca8 expref: 5 pid: 12098 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127381.570962:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df68325cf00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1876035752767488:192.168.206.40@tcp:104: 00000100:00100000:1.0:1789127381.571179:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7af6189c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789127381.577178:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127381.577239:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733882624 00000100:00100000:0.0:1789127381.577249:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733882624 00010000:00010000:0.0:1789127381.577288:0:8454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c024300d72 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7ca8 expref: 6 pid: 12098 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127381.577332:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 67 00000100:00100000:0.0:1789127381.577341:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeab8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:81b0e267-d7e0-4043-b34e-eec2dc4c5a6b+6:2349:x1876035733882624:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789127381.577356:0:8454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789127381.577362:0:8454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c024300d72 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7ca8 expref: 6 pid: 12098 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127381.577375:0:8454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c024300d72 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7ca8 expref: 6 pid: 12098 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127381.577396:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df782d66900) 00010000:00010000:0.0:1789127381.577402:0:8454:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c024300db1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127381.577411:0:8454:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c024300db1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127381.577418:0:8454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c024300db1 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127381.577454:0:8454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789127381.577515:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeab8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:81b0e267-d7e0-4043-b34e-eec2dc4c5a6b+6:2349:x1876035733882624:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 175us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127381.577522:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 67 00010000:00010000:3.0:1789127381.577989:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c024300d72 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7ca8 expref: 5 pid: 12098 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127381.578006:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df68325cf00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1876035752767488:192.168.206.40@tcp:104: 00010000:00010000:3.0:1789127381.578025:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c024300db1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127381.578034:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c024300db1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127381.578039:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c024300db1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127381.578060:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0e00/0xeeacf7c024300db8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127381.578071:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0e00/0xeeacf7c024300db8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127381.578079:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0e00/0xeeacf7c024300db8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789127381.580966:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000004:00200000:3.0:1789127381.583551:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1789127381.583576:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c024300db1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127381.583587:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c024300db1 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127381.583595:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c024300db1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127381.583600:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd97600 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:3.0:1789127381.583605:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c024300db1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127381.583612:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c024300db1 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127381.583629:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df782d66900) 00010000:00010000:3.0:1789127381.583632:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127381.583637:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c024300db1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127381.583665:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c024300db1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789127381.583683:0:5832:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000000ee0d064 reply state 000000009c028fbf transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0e00/0xeeacf7c024300db8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127381.583692:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789127381.583814:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bbd870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+14:11536:x1876035733882496:12345-192.168.206.40@tcp:36:lfs.0 Request processed in 20164us (20512us total) trans 4294967417 rc 0/0 00000100:00100000:3.0:1789127381.583823:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 140 00010000:00010000:3.0:1789127381.587195:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0e00/0xeeacf7c024300db8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127381.587220:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0e00/0xeeacf7c024300db8 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127381.587228:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0e00/0xeeacf7c024300db8 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127381.587235:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df798df0e00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:3.0:1789127381.587240:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0e00/0xeeacf7c024300db8 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127381.587248:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0e00/0xeeacf7c024300db8 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127381.587264:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8df79f06c600) 00010000:00010000:3.0:1789127381.587267:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127381.587271:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0e00/0xeeacf7c024300db8 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127381.587278:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0e00/0xeeacf7c024300db8 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127381.675330:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127381.675494:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733882752 00000100:00100000:0.0:1789127381.675505:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733882752 00000100:00100000:0.0:1789127381.675556:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 141 00000100:00100000:0.0:1789127381.675565:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeaba580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+13:11544:x1876035733882752:12345-192.168.206.40@tcp:101:lctl.0 00010000:00010000:0.0:1789127381.675588:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127381.675611:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729200/0xeeacf7c024300dbf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7cbd expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127381.675689:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728600/0xeeacf7c024300dc6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127381.675703:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728600/0xeeacf7c024300dc6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127381.675714:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728600/0xeeacf7c024300dc6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789127381.675773:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1789127381.675777:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1789127381.675823:0:5831:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728600/0xeeacf7c024300dc6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127381.675848:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729200/0xeeacf7c024300dbf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7cbd expref: 15 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127381.675882:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728600/0xeeacf7c024300dc6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7cbd expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127381.675889:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df782a68a00) 00010000:00010000:0.0:1789127381.675892:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789127381.675895:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7ae728600, rc 0) 00000100:00100000:0.0:1789127381.675949:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeaba580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+14:11544:x1876035733882752:12345-192.168.206.40@tcp:101:lctl.0 Request processed in 385us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127381.675956:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 141 00000100:00100000:2.0:1789127381.747080:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127381.747359:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733882880 00000100:00100000:1.0:1789127381.747370:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733882880 00000100:00100000:1.0:1789127381.747464:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 142 00000100:00100000:1.0:1789127381.747474:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bbd852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+14:11550:x1876035733882880:12345-192.168.206.40@tcp:101:bash.0 00010000:00010000:1.0:1789127381.747495:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127381.747513:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96400/0xeeacf7c024300dcd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7cc4 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127381.747587:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024300dd4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127381.747622:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024300dd4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127381.747648:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024300dd4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127381.747677:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024300ddb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127381.747684:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024300ddb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127381.747691:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024300ddb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127381.748260:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0e00/0xeeacf7c024300de2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127381.748272:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0e00/0xeeacf7c024300de2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127381.748280:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0e00/0xeeacf7c024300de2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789127381.748311:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:3.0:1789127381.748322:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789127381.748350:0:5830:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0e00/0xeeacf7c024300de2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127381.748362:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024300dd4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127381.748369:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024300dd4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127381.748375:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024300dd4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127381.748381:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd96a00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:3.0:1789127381.748385:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024300dd4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127381.748392:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024300dd4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127381.748403:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df782a68a00) 00010000:00010000:3.0:1789127381.748406:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127381.748411:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024300dd4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127381.748417:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024300dd4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127381.748431:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024300ddb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127381.748437:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024300ddb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127381.748453:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024300ddb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127381.748458:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd97e00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:3.0:1789127381.748461:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024300ddb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127381.748467:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024300ddb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127381.748475:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8df782d66700) 00010000:00010000:3.0:1789127381.748477:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127381.748480:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024300ddb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127381.748486:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024300ddb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127381.748520:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96400/0xeeacf7c024300dcd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7cc4 expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127381.748533:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0e00/0xeeacf7c024300de2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7cc4 expref: 15 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127381.748539:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8df79f06cd00) 00010000:00010000:3.0:1789127381.748541:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789127381.748543:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df798df0e00, rc 0) 00000100:00100000:3.0:1789127381.748982:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bbd852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+15:11550:x1876035733882880:12345-192.168.206.40@tcp:101:bash.0 Request processed in 1508us (1909us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127381.749000:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 142 00000100:00100000:0.0:1789127381.758343:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127381.759013:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733883136 00000100:00100000:3.0:1789127381.759024:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733883136 00000100:00100000:3.0:1789127381.759078:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 143 00000100:00100000:3.0:1789127381.759087:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df682e703c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+15:11550:x1876035733883136:12345-192.168.206.40@tcp:101:bash.0 00010000:00010000:3.0:1789127381.759108:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127381.759129:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024300de9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7ccb expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127381.759269:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c024300df0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127381.759286:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c024300df0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127381.759299:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c024300df0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127381.759358:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c024300df7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127381.759367:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c024300df7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127381.759373:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c024300df7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789127381.760871:0:5832:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:2.0:1789127381.761039:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c024300dfe lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127381.761053:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c024300dfe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127381.761062:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c024300dfe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127381.761094:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c024300df0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127381.761101:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c024300df0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127381.761115:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c024300df0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127381.761121:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df798df1e00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:2.0:1789127381.761126:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c024300df0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127381.761133:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c024300df0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127381.761145:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8df79f06cd00) 00010000:00010000:2.0:1789127381.761148:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789127381.761153:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c024300df0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127381.761159:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c024300df0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789127381.761172:0:5832:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000005d6416cc reply state 00000000bb60a315 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c024300df7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127381.761181:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789127381.761213:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024300de9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7ccb expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127381.761231:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c024300dfe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7ccb expref: 17 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127381.761238:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df7906f6f00) 00010000:00010000:2.0:1789127381.761240:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789127381.761248:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df79032c200, rc 0) 00000100:00100000:2.0:1789127381.761326:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df682e703c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+18:11550:x1876035733883136:12345-192.168.206.40@tcp:101:bash.0 Request processed in 2238us (3755us total) trans 4294967418 rc 0/0 00000100:00100000:2.0:1789127381.761335:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 143 00010000:00010000:3.0:1789127381.767978:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c024300df7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127381.768011:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c024300df7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127381.768018:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c024300df7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127381.768023:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df798df0800 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:3.0:1789127381.768028:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c024300df7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127381.768036:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c024300df7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127381.768052:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8df79f06c600) 00010000:00010000:3.0:1789127381.768055:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127381.768060:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c024300df7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127381.768066:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c024300df7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127381.772774:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127381.773019:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733883264 00000100:00100000:3.0:1789127381.773028:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733883264 00000100:00100000:3.0:1789127381.773081:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 47 00000100:00100000:3.0:1789127381.773091:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df682e73840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+5:2348:x1876035733883264:12345-192.168.206.40@tcp:101:bash.0 00010000:00010000:3.0:1789127381.773117:0:6688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127381.773142:0:6688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b830ec46/0xeeacf7c024300e0c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7cd2 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789127381.773183:0:6688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789127381.773202:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=327s v=(0 0) 00010000:00010000:3.0:1789127381.773207:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127381.773215:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b830ec46/0xeeacf7c024300e0c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7cd2 expref: 6 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127381.773233:0:6688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b830ec46/0xeeacf7c024300e0c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7cd2 expref: 6 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127381.773245:0:6688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df798df0200, rc 0) 00000100:00100000:3.0:1789127381.773307:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df682e73840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+6:2348:x1876035733883264:12345-192.168.206.40@tcp:101:bash.0 Request processed in 217us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127381.773314:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 47 00000100:00100000:0.0:1789127381.775733:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127381.775909:0:8063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733883392 00000100:00100000:3.0:1789127381.775918:0:8063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733883392 00000100:00100000:3.0:1789127381.775972:0:8063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 48 00000100:00100000:3.0:1789127381.775982:0:8063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df682e70b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+6:11550:x1876035733883392:12345-192.168.206.40@tcp:101:bash.0 00010000:00010000:3.0:1789127381.775998:0:8063:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127381.776016:0:8063:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000135bd677/0xeeacf7c024300e13 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7cd9 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127381.776045:0:8063:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b830ec46/0xeeacf7c024300e0c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7cd2 expref: 7 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127381.776071:0:8063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127381.776076:0:8063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127381.776082:0:8063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000135bd677/0xeeacf7c024300e13 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7cd9 expref: 7 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127381.776190:0:8063:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b830ec46/0xeeacf7c024300e0c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7cd2 expref: 7 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127381.776204:0:8063:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b830ec46/0xeeacf7c024300e0c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7cd2 expref: 7 pid: 6688 timeout: 427 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127381.776218:0:8063:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df790629a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8063:1876035752767616:192.168.206.40@tcp:104: 00000100:00100000:3.0:1789127381.776306:0:8063:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df784d46180 going to sleep for 11 seconds 00000100:00100000:1.0:1789127381.779129:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127381.779223:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733883520 00000100:00100000:2.0:1789127381.779232:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733883520 00010000:00010000:2.0:1789127381.779270:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b830ec46/0xeeacf7c024300e0c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7cd2 expref: 8 pid: 6688 timeout: 427 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127381.779316:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 68 00000100:00100000:2.0:1789127381.779325:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeaba940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+8:2348:x1876035733883520:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789127381.779338:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789127381.779359:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b830ec46/0xeeacf7c024300e0c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7cd2 expref: 8 pid: 6688 timeout: 427 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127381.779367:0:8063:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df790629a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8063:1876035752767616:192.168.206.40@tcp:104: 00010000:00010000:2.0:1789127381.779372:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b830ec46/0xeeacf7c024300e0c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7cd2 expref: 8 pid: 6688 timeout: 427 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127381.779393:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b830ec46/0xeeacf7c024300e0c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7cd2 expref: 8 pid: 6688 timeout: 427 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127381.783116:0:8063:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000135bd677/0xeeacf7c024300e13 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7cd9 expref: 7 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127381.783140:0:8063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127381.783144:0:8063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127381.783154:0:8063:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000135bd677/0xeeacf7c024300e13 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7cd9 expref: 7 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127381.783163:0:8063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000135bd677/0xeeacf7c024300e13 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7cd9 expref: 7 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127381.783229:0:8063:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000135bd677/0xeeacf7c024300e13 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7cd9 expref: 7 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127381.783244:0:8063:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df790629a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8063:1876035752767744:192.168.206.40@tcp:105: 00000100:00100000:3.0:1789127381.783412:0:8063:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df784d46180 going to sleep for 11 seconds 00010000:00010000:2.0:1789127381.784340:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789127381.784395:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeaba940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+7:2348:x1876035733883520:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 5068us (5272us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127381.784405:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 68 00000100:00100000:3.0:1789127381.786342:0:8063:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df790629a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8063:1876035752767744:192.168.206.40@tcp:105: 00010000:00010000:3.0:1789127381.786366:0:8063:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df798df1e00, rc 0) 00000100:00100000:3.0:1789127381.786425:0:8063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df682e70b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+6:11550:x1876035733883392:12345-192.168.206.40@tcp:101:bash.0 Request processed in 10443us (10699us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127381.786435:0:8063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 48 00000100:00100000:1.0:1789127381.790217:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127381.790313:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733883776 00000100:00100000:2.0:1789127381.790334:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733883776 00000100:00100000:2.0:1789127381.790390:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 36 00000100:00100000:2.0:1789127381.790399:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79a3a03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+17:11550:x1876035733883776:12345-192.168.206.40@tcp:35:bash.0 00000100:00100000:2.0:1789127381.790735:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79a3a03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+18:11550:x1876035733883776:12345-192.168.206.40@tcp:35:bash.0 Request processed in 335us (525us total) trans 4294967419 rc 0/0 00000100:00100000:2.0:1789127381.790743:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 36 00000100:00100000:0.0:1789127381.876082:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127381.876179:0:12098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733884032 00000100:00100000:1.0:1789127381.876189:0:12098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733884032 00000100:00100000:1.0:1789127381.876246:0:12098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 144 00000100:00100000:1.0:1789127381.876256:0:12098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df682e71680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+18:11561:x1876035733884032:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:1.0:1789127381.876278:0:12098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127381.876299:0:12098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c024300e1a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7ce0 expref: -99 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789127381.876406:0:12098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1789127381.876526:0:12098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c024300e1a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7ce0 expref: 20 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127381.876556:0:12098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df782a68a00) 00010000:00010000:1.0:1789127381.876559:0:12098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789127381.876565:0:12098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c024300e1a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7ce0 expref: 20 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127381.877739:0:12098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7bbd97600, rc 0) 00000100:00100000:1.0:1789127381.877954:0:12098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df682e71680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+19:11561:x1876035733884032:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 1695us (1877us total) trans 4294967420 rc 301/301 00000100:00100000:1.0:1789127381.877963:0:12098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 144 00000100:00100000:1.0:1789127381.880879:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127381.880959:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733884288 00000100:00100000:3.0:1789127381.880968:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733884288 00000100:00100000:3.0:1789127381.881013:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 37 00000100:00100000:3.0:1789127381.881024:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79a3a0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+19:11561:x1876035733884288:12345-192.168.206.40@tcp:35:lfs.0 00000100:00100000:3.0:1789127381.881271:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79a3a0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+20:11561:x1876035733884288:12345-192.168.206.40@tcp:35:lfs.0 Request processed in 249us (400us total) trans 4294967421 rc 0/0 00000100:00100000:3.0:1789127381.881279:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 37 00000100:00100000:3.0:1789127381.967583:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127381.967922:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733884416 00000100:00100000:0.0:1789127381.967931:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733884416 00000100:00100000:0.0:1789127381.967991:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 145 00000100:00100000:0.0:1789127381.968002:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df790629a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+20:11567:x1876035733884416:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:0.0:1789127381.968025:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127381.968044:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729200/0xeeacf7c024300e28 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7ce7 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127381.968105:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728c00/0xeeacf7c024300e2f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127381.968120:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728c00/0xeeacf7c024300e2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127381.968148:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728c00/0xeeacf7c024300e2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789127381.968203:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:0.0:1789127381.968207:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1789127381.968229:0:5830:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728c00/0xeeacf7c024300e2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127381.968254:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729200/0xeeacf7c024300e28 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7ce7 expref: 22 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127381.968272:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728c00/0xeeacf7c024300e2f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7ce7 expref: 21 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127381.968280:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8df79f06cd00) 00010000:00010000:0.0:1789127381.968284:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789127381.968287:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7ae728c00, rc 0) 00000100:00100000:0.0:1789127381.968363:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df790629a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+21:11567:x1876035733884416:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 362us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127381.968371:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 145 00000100:00100000:1.0:1789127381.972444:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127381.972538:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733884672 00000100:00100000:3.0:1789127381.972548:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733884672 00000100:00100000:3.0:1789127381.972907:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 146 00000100:00100000:3.0:1789127381.972919:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79a3a2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+21:11567:x1876035733884672:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:3.0:1789127381.972939:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127381.972974:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c024300e36 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7cee expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127381.973069:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024300e3d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127381.973084:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024300e3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127381.973095:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024300e3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789127381.973107:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789127381.973232:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c024300e36 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7cee expref: 24 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127381.973252:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024300e3d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7cee expref: 23 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127381.973261:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df7906f6f00) 00010000:00010000:3.0:1789127381.973264:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789127381.973268:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df798df1c00, rc 0) 00000100:00100000:3.0:1789127381.973373:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79a3a2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+23:11567:x1876035733884672:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 456us (937us total) trans 4294967422 rc 0/0 00000100:00100000:3.0:1789127381.973382:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 146 00000100:00100000:0.0:1789127381.981823:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127381.981925:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127381.981956:0:12098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733884928 00000100:00100000:0.0:1789127381.981964:0:12098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733884928 00000100:00100000:0.0:1789127381.982015:0:12098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 147 00000100:00100000:0.0:1789127381.982024:0:12098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df682e72940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+23:11567:x1876035733884928:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:0.0:1789127381.982047:0:12098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127381.982079:0:12098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728a00/0xeeacf7c024300e4b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7cf5 expref: -99 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127381.982182:0:12098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729000/0xeeacf7c024300e52 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127381.982200:0:12098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729000/0xeeacf7c024300e52 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127381.982212:0:12098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729000/0xeeacf7c024300e52 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789127381.982228:0:12098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1789127381.982365:0:12098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728a00/0xeeacf7c024300e4b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7cf5 expref: 26 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127381.982388:0:12098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729000/0xeeacf7c024300e52 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7cf5 expref: 25 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127381.982396:0:12098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df7906f6f00) 00010000:00010000:0.0:1789127381.982399:0:12098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789127381.982406:0:12098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7ae729000, rc 0) 00000100:00100000:0.0:1789127381.982480:0:12098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df682e72940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+25:11567:x1876035733884928:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 457us (555us total) trans 4294967423 rc 0/0 00000100:00100000:0.0:1789127381.982488:0:12098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 147 00000100:00100000:3.0:1789127381.982598:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733885056 00000100:00100000:3.0:1789127381.982603:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733885056 00000100:00100000:3.0:1789127381.982647:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 10 00000100:00100000:3.0:1789127381.982667:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df682e70780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+25:2347:x1876035733885056:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789127381.982689:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127381.982709:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024300e3d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7cee expref: 25 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127381.982725:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df7906f6f00) 00010000:00010000:3.0:1789127381.982728:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127381.982772:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df682e70780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+24:2347:x1876035733885056:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 114us (984us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127381.982779:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 10 00000100:00100000:0.0:1789127381.991203:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127381.991290:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733885184 00000100:00100000:3.0:1789127381.991299:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733885184 00000100:00100000:3.0:1789127381.991357:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 49 00000100:00100000:3.0:1789127381.991366:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df787b8e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+6:2348:x1876035733885184:12345-192.168.206.40@tcp:1:lfs.0 00010000:00010000:3.0:1789127381.991409:0:6688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000466c8d8e/0xeeacf7c024300e60 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127381.991427:0:6688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000135bd677/0xeeacf7c024300e13 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7cd9 expref: 6 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127381.991435:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789127381.991440:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789127381.991445:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000466c8d8e/0xeeacf7c024300e60 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127381.991479:0:6688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000135bd677/0xeeacf7c024300e13 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7cd9 expref: 6 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127381.991511:0:6688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000135bd677/0xeeacf7c024300e13 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7cd9 expref: 6 pid: 8063 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127381.991526:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79062ad00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6688:1876035752767872:192.168.206.40@tcp:104: 00000100:00100000:3.0:1789127381.991614:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df784d46180 going to sleep for 11 seconds 00000100:00100000:2.0:1789127381.996290:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127381.997699:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733885312 00000100:00100000:1.0:1789127381.997711:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733885312 00002000:00100000:1.0:1789127381.997763:0:6694:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8df7bbd85680 x1876035733885312/t0(0) o4->28762f98-a240-4662-a754-e28bbeb6cb4b@192.168.206.40@tcp:117/0 lens 504/0 e 0 to 0 dl 1789127392 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789127381.997775:0:6694:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff8df7bbd85680 with x1876035733885312 ext(0->12) 00010000:00010000:1.0:1789127381.997783:0:6694:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000135bd677/0xeeacf7c024300e13 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7cd9 expref: 7 pid: 8063 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127381.997844:0:6694:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000135bd677/0xeeacf7c024300e13 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7cd9 expref: 7 pid: 8063 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789127381.997853:0:6694:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8df7bbd85680 00000100:00100000:1.0:1789127381.997876:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 2 00000100:00100000:1.0:1789127381.997886:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bbd85680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+7:2348:x1876035733885312:12345-192.168.206.40@tcp:4:lfs.0 00000100:00100000:1.0:1789127381.998844:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bbd85680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+9:2348:x1876035733885312:12345-192.168.206.40@tcp:4:lfs.0 Request processed in 954us (2557us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1789127381.998854:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 2 00002000:00100000:1.0:1789127381.998862:0:6694:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8df7bbd85680 x1876035733885312/t4294967305(0) o4->28762f98-a240-4662-a754-e28bbeb6cb4b@192.168.206.40@tcp:117/0 lens 504/448 e 0 to 0 dl 1789127392 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789127381.998872:0:6694:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff8df7bbd85680 with x1876035733885312 ext(0->12) 00010000:00010000:1.0:1789127381.998879:0:6694:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000135bd677/0xeeacf7c024300e13 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7cd9 expref: 9 pid: 8063 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127381.998893:0:6694:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000135bd677/0xeeacf7c024300e13 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7cd9 expref: 9 pid: 8063 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789127381.998900:0:6694:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8df7bbd85680 00000100:00100000:3.0:1789127382.002971:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79062ad00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6688:1876035752767872:192.168.206.40@tcp:104: 00000100:00100000:2.0:1789127382.003198:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00010000:00010000:3.0:1789127382.003333:0:6688:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000466c8d8e/0xeeacf7c024300e60 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127382.003944:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733885440 00000100:00100000:0.0:1789127382.003952:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733885440 00010000:00010000:0.0:1789127382.004009:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000135bd677/0xeeacf7c024300e13 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7cd9 expref: 9 pid: 8063 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127382.004069:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 69 00000100:00100000:0.0:1789127382.004079:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bbd85a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+9:2347:x1876035733885440:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789127382.004094:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789127382.004111:0:5816:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1789127382.004114:0:5816:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1789127380 00002000:00010000:0.0:1789127382.004116:0:5816:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1789127381 00002000:00010000:0.0:1789127382.004118:0:5816:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1789127380 00010000:00010000:0.0:1789127382.004125:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000135bd677/0xeeacf7c024300e13 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7cd9 expref: 9 pid: 8063 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.004138:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000135bd677/0xeeacf7c024300e13 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7cd9 expref: 9 pid: 8063 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.004162:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000135bd677/0xeeacf7c024300e13 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7cd9 expref: 9 pid: 8063 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.004179:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789127382.004183:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789127382.004189:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000466c8d8e/0xeeacf7c024300e60 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.004198:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000466c8d8e/0xeeacf7c024300e60 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.004217:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789127382.004284:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bbd85a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+8:2347:x1876035733885440:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 206us (1087us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127382.004292:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 69 00010000:00010000:0.0:1789127382.004316:0:6688:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000466c8d8e/0xeeacf7c024300e60 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.004325:0:6688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000466c8d8e/0xeeacf7c024300e60 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.004349:0:6688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000466c8d8e/0xeeacf7c024300e60 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.004356:0:6688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000466c8d8e/0xeeacf7c024300e60 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.004364:0:6688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000466c8d8e/0xeeacf7c024300e60 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.004370:0:6688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df798df1c00 already unused, calling callback (ffffffffc17a4550) 00010000:00010000:0.0:1789127382.004374:0:6688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000466c8d8e/0xeeacf7c024300e60 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.004382:0:6688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000466c8d8e/0xeeacf7c024300e60 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.004393:0:6688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000466c8d8e/0xeeacf7c024300e60 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.004412:0:6688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000466c8d8e/0xeeacf7c024300e60 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127382.004470:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df787b8e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+7:2348:x1876035733885184:12345-192.168.206.40@tcp:1:lfs.0 Request processed in 13104us (13276us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127382.004477:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 49 00000100:00080000:1.0:1789127382.006755:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789127382.006901:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127382.006985:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733885696 00000100:00100000:3.0:1789127382.006994:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733885696 00000100:00100000:3.0:1789127382.007045:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 38 00000100:00100000:3.0:1789127382.007055:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df791568050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+24:11567:x1876035733885696:12345-192.168.206.40@tcp:35:lfs.0 00000004:00010000:3.0:1789127382.007111:0:5833:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729000/0xeeacf7c024300e52 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7cf5 expref: 24 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789127382.007323:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:3.0:1789127382.007359:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:3.0:1789127382.007986:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00010000:00010000:3.0:1789127382.008047:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024300e67 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127382.008062:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c024300dfe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7ccb expref: 28 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127382.008083:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024300e67 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127382.008116:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c024300dfe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7ccb expref: 28 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127382.008132:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c024300dfe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7ccb expref: 28 pid: 5832 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127382.008147:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79062ad00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5833:1876035752768000:192.168.206.40@tcp:104: 00000100:00100000:3.0:1789127382.008232:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df782cb8e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789127382.012482:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127382.012573:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733885824 00000100:00100000:1.0:1789127382.012582:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733885824 00010000:00010000:1.0:1789127382.012619:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c024300dfe lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7ccb expref: 29 pid: 5832 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127382.012674:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 70 00000100:00100000:1.0:1789127382.012685:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79206e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+29:2349:x1876035733885824:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789127382.012711:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789127382.012718:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c024300dfe lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7ccb expref: 29 pid: 5832 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127382.012731:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c024300dfe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7ccb expref: 29 pid: 5832 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127382.012766:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df7906f6f00) 00010000:00010000:1.0:1789127382.012771:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024300e67 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127382.012779:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024300e67 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127382.012823:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024300e67 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127382.012843:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789127382.012893:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79206e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+29:2349:x1876035733885824:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 209us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127382.012901:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 70 00010000:00010000:3.0:1789127382.014311:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c024300dfe lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7ccb expref: 28 pid: 5832 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127382.014345:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79062ad00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5833:1876035752768000:192.168.206.40@tcp:104: 00010000:00010000:3.0:1789127382.014367:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024300e67 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127382.014376:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024300e67 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127382.014382:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024300e67 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789127382.014513:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000001:00080000:3.0:1789127382.015209:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:3.0:1789127382.015318:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79062ad00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5833:1876035752768128:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789127382.015441:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127382.015473:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df782cb8840 going to sleep for 11 seconds 00000100:00100000:0.0:1789127382.017706:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752768128 00000100:00100000:0.0:1789127382.017720:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752768128 00000100:00100000:0.0:1789127382.017823:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789127382.017833:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df68325ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5833:x1876035752768128:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789127382.017938:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df68325ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5833:x1876035752768128:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 107us (2497us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127382.017946:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789127382.018365:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79062ad00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5833:1876035752768128:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1789127382.019297:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:3.0:1789127382.019380:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df68325cf00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5833:1876035752768256:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789127382.019433:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127382.019457:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7b46be480 going to sleep for 11 seconds 00000100:00100000:0.0:1789127382.019965:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752768256 00000100:00100000:0.0:1789127382.019972:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752768256 00000100:00100000:0.0:1789127382.020016:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789127382.020024:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79062ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5833:x1876035752768256:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789127382.020193:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79062ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5833:x1876035752768256:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 169us (759us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1789127382.020200:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1789127382.020279:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789127382.020388:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df68325cf00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5833:1876035752768256:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1789127382.020466:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:3.0:1789127382.020505:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024300e67 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127382.020515:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024300e67 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127382.020522:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024300e67 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127382.020528:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df798df0200 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:3.0:1789127382.021078:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024300e67 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127382.021090:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024300e67 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127382.021106:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df7906f6f00) 00010000:00010000:3.0:1789127382.021109:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1789127382.021114:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024300e67 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127382.021139:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024300e67 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789127382.021430:0:5833:0:(mdd_object.c:4024:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1789127382.021526:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:0.0:1789127382.021755:0:5833:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 328177965185ns, next at 329177962178ns, rc = 0 00000001:00080000:0.0:1789127382.021764:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:0.0:1789127382.021845:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df7906f6f00) 00010000:00010000:0.0:1789127382.021848:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789127382.021856:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729000/0xeeacf7c024300e52 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7cf5 expref: 32 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127382.022012:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df791568050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+31:11567:x1876035733885696:12345-192.168.206.40@tcp:35:lfs.0 Request processed in 14957us (15113us total) trans 4294967432 rc 0/0 00000100:00100000:0.0:1789127382.022023:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 38 00000020:00080000:0.0:1789127382.022027:0:5833:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1789127382.026080:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127382.026231:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733885952 00000100:00100000:0.0:1789127382.026241:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733885952 00000100:00100000:0.0:1789127382.026330:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 148 00000100:00100000:0.0:1789127382.026340:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79206f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+31:11567:x1876035733885952:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:0.0:1789127382.026362:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127382.026382:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729200/0xeeacf7c024300e6e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7cfc expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.026447:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729200/0xeeacf7c024300e6e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7cfc expref: 32 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.026460:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729200/0xeeacf7c024300e6e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7cfc expref: 32 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.026479:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df782a68000) 00010000:00010000:0.0:1789127382.026483:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789127382.026486:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7ae729200, rc 0) 00000100:00100000:0.0:1789127382.026590:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79206f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+32:11567:x1876035733885952:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 251us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127382.026615:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 148 00000100:00100000:1.0:1789127382.033029:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127382.033127:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733886208 00000100:00100000:0.0:1789127382.033136:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733886208 00000100:00100000:0.0:1789127382.033192:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 39 00000100:00100000:0.0:1789127382.033203:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79a3a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+32:11567:x1876035733886208:12345-192.168.206.40@tcp:35:lfs.0 00000100:00100000:0.0:1789127382.033835:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79a3a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+33:11567:x1876035733886208:12345-192.168.206.40@tcp:35:lfs.0 Request processed in 631us (811us total) trans 4294967433 rc 0/0 00000100:00100000:0.0:1789127382.033844:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 39 00000100:00100000:3.0:1789127382.113714:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127382.113883:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733886464 00000100:00100000:2.0:1789127382.113891:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733886464 00000100:00100000:2.0:1789127382.113951:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 149 00000100:00100000:2.0:1789127382.113961:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7af5cc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+33:11577:x1876035733886464:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:2.0:1789127382.113984:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127382.114003:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c400/0xeeacf7c024300e75 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7d03 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789127382.114107:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1789127382.114229:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c400/0xeeacf7c024300e75 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d03 expref: 35 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127382.114244:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df782a68a00) 00010000:00010000:2.0:1789127382.114247:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789127382.114252:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c400/0xeeacf7c024300e75 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d03 expref: 35 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127382.114283:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df79032c400, rc 0) 00000100:00100000:2.0:1789127382.114341:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7af5cc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+34:11577:x1876035733886464:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 380us (634us total) trans 4294967434 rc 301/301 00000100:00100000:2.0:1789127382.114349:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 149 00000100:00100000:2.0:1789127382.120923:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127382.121099:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733886592 00000100:00100000:0.0:1789127382.121108:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733886592 00000100:00100000:0.0:1789127382.121165:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 150 00000100:00100000:0.0:1789127382.121174:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79a2c5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+34:11577:x1876035733886592:12345-192.168.206.40@tcp:34:lfs.0 00010000:00010000:0.0:1789127382.121251:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729000/0xeeacf7c024300e83 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.121266:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729000/0xeeacf7c024300e83 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.121278:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729000/0xeeacf7c024300e83 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.121292:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729400/0xeeacf7c024300e8a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.121299:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729400/0xeeacf7c024300e8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.121305:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729400/0xeeacf7c024300e8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.121406:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728e00/0xeeacf7c024300e91 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.121414:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728e00/0xeeacf7c024300e91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.121421:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728e00/0xeeacf7c024300e91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789127382.121455:0:5831:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728e00/0xeeacf7c024300e91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.121467:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729000/0xeeacf7c024300e83 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.121485:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729000/0xeeacf7c024300e83 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.121492:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729000/0xeeacf7c024300e83 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.121498:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7ae729000 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:0.0:1789127382.121503:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729000/0xeeacf7c024300e83 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.121510:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729000/0xeeacf7c024300e83 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.121520:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8df79f06cd00) 00010000:00010000:0.0:1789127382.121523:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127382.121527:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729000/0xeeacf7c024300e83 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.121539:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729000/0xeeacf7c024300e83 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.121551:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729400/0xeeacf7c024300e8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.121557:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729400/0xeeacf7c024300e8a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.121563:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729400/0xeeacf7c024300e8a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.121569:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7ae729400 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:0.0:1789127382.121572:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729400/0xeeacf7c024300e8a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.121578:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729400/0xeeacf7c024300e8a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.121585:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8df782a68d00) 00010000:00010000:0.0:1789127382.121587:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127382.121590:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729400/0xeeacf7c024300e8a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.121595:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729400/0xeeacf7c024300e8a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.121608:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728e00/0xeeacf7c024300e91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.121614:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728e00/0xeeacf7c024300e91 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.121625:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728e00/0xeeacf7c024300e91 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.121630:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7ae728e00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:0.0:1789127382.121633:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728e00/0xeeacf7c024300e91 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.121639:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728e00/0xeeacf7c024300e91 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.121647:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df782a68000) 00010000:00010000:0.0:1789127382.121649:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127382.121651:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728e00/0xeeacf7c024300e91 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.121667:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728e00/0xeeacf7c024300e91 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127382.121735:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79a2c5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+34:11577:x1876035733886592:12345-192.168.206.40@tcp:34:lfs.0 Request processed in 561us (820us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127382.121743:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 150 00000100:00100000:1.0:1789127382.128077:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127382.128161:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733886848 00000100:00100000:3.0:1789127382.128170:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733886848 00000100:00100000:3.0:1789127382.128226:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 40 00000100:00100000:3.0:1789127382.128237:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79a3a1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+34:11577:x1876035733886848:12345-192.168.206.40@tcp:35:lfs.0 00000100:00100000:3.0:1789127382.128498:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79a3a1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+35:11577:x1876035733886848:12345-192.168.206.40@tcp:35:lfs.0 Request processed in 262us (430us total) trans 4294967435 rc 0/0 00000100:00100000:3.0:1789127382.128507:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 40 00000100:00100000:3.0:1789127382.180042:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127382.180342:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733887104 00000100:00100000:0.0:1789127382.180351:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733887104 00000100:00100000:0.0:1789127382.180415:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 151 00000100:00100000:0.0:1789127382.180425:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeb16d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+35:11580:x1876035733887104:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:0.0:1789127382.180449:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127382.180479:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728e00/0xeeacf7c024300e98 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7d0a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.180571:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729400/0xeeacf7c024300e9f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.180585:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729400/0xeeacf7c024300e9f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.180594:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729400/0xeeacf7c024300e9f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.180607:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729000/0xeeacf7c024300ea6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.180614:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729000/0xeeacf7c024300ea6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.180620:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729000/0xeeacf7c024300ea6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.180759:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c024300ead lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.180768:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c024300ead lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.180776:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c024300ead lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789127382.180785:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1789127382.181453:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729400/0xeeacf7c024300e9f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.181461:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729400/0xeeacf7c024300e9f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.181534:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729400/0xeeacf7c024300e9f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.181541:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7ae729400 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:0.0:1789127382.181545:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729400/0xeeacf7c024300e9f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.181553:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729400/0xeeacf7c024300e9f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.181566:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8df79f06cd00) 00010000:00010000:0.0:1789127382.181569:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127382.181574:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729400/0xeeacf7c024300e9f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.181580:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729400/0xeeacf7c024300e9f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.181598:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729000/0xeeacf7c024300ea6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.181605:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729000/0xeeacf7c024300ea6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.181612:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729000/0xeeacf7c024300ea6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.181616:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7ae729000 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:0.0:1789127382.181619:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729000/0xeeacf7c024300ea6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.181777:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729000/0xeeacf7c024300ea6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.181982:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8df782a68d00) 00010000:00010000:0.0:1789127382.181987:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127382.181991:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729000/0xeeacf7c024300ea6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.181997:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729000/0xeeacf7c024300ea6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.182049:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728e00/0xeeacf7c024300e98 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d0a expref: 38 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.182062:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c024300ead lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d0a expref: 37 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.182084:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df782a68000) 00010000:00010000:0.0:1789127382.182086:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789127382.182089:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7ae729c00, rc 0) 00000100:00100000:0.0:1789127382.182220:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeb16d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+37:11580:x1876035733887104:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 1796us (2185us total) trans 4294967436 rc 0/0 00000100:00100000:0.0:1789127382.182229:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 151 00000100:00100000:2.0:1789127382.187208:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127382.187411:0:12098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733887232 00000100:00100000:0.0:1789127382.187419:0:12098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733887232 00000100:00100000:0.0:1789127382.187551:0:12098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 152 00000100:00100000:0.0:1789127382.187563:0:12098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79a2c61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+37:11580:x1876035733887232:12345-192.168.206.40@tcp:54:lfs.0 00010000:00010000:0.0:1789127382.187718:0:12098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728400/0xeeacf7c024300ebb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.187735:0:12098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728400/0xeeacf7c024300ebb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.187745:0:12098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728400/0xeeacf7c024300ebb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.187770:0:12098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728400/0xeeacf7c024300ebb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.187776:0:12098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728400/0xeeacf7c024300ebb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.187782:0:12098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728400/0xeeacf7c024300ebb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.187919:0:12098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7ae728400 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:0.0:1789127382.187924:0:12098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728400/0xeeacf7c024300ebb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.187933:0:12098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728400/0xeeacf7c024300ebb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.187944:0:12098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df782a68000) 00010000:00010000:0.0:1789127382.187947:0:12098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789127382.187952:0:12098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728400/0xeeacf7c024300ebb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.187957:0:12098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728400/0xeeacf7c024300ebb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127382.188133:0:12098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79a2c61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+37:11580:x1876035733887232:12345-192.168.206.40@tcp:54:lfs.0 Request processed in 572us (933us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127382.188142:0:12098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 152 00000100:00100000:1.0:1789127382.197459:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127382.198269:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733887488 00000100:00100000:3.0:1789127382.198279:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733887488 00000100:00100000:3.0:1789127382.198334:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 41 00000100:00100000:3.0:1789127382.198344:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79a3a03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+37:11580:x1876035733887488:12345-192.168.206.40@tcp:35:lfs.0 00000100:00100000:3.0:1789127382.198699:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79a3a03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+38:11580:x1876035733887488:12345-192.168.206.40@tcp:35:lfs.0 Request processed in 281us (1171us total) trans 4294967437 rc 0/0 00000100:00100000:3.0:1789127382.198708:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 41 00000100:00100000:3.0:1789127382.445714:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127382.445872:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733887744 00000100:00100000:0.0:1789127382.445881:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733887744 00000100:00100000:0.0:1789127382.446033:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 153 00000100:00100000:0.0:1789127382.446045:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae979680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+38:11611:x1876035733887744:12345-192.168.206.40@tcp:101:cat.0 00010000:00010000:0.0:1789127382.446067:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127382.446087:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728400/0xeeacf7c024300ec2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7d11 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.446173:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728e00/0xeeacf7c024300ec9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.446188:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728e00/0xeeacf7c024300ec9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.446199:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728e00/0xeeacf7c024300ec9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789127382.446209:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1789127382.446319:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728400/0xeeacf7c024300ec2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d11 expref: 41 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.446336:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728e00/0xeeacf7c024300ec9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d11 expref: 40 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.446344:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df782a68000) 00010000:00010000:0.0:1789127382.446359:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789127382.446364:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7ae728e00, rc 0) 00000100:00100000:0.0:1789127382.446436:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae979680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+40:11611:x1876035733887744:12345-192.168.206.40@tcp:101:cat.0 Request processed in 393us (728us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1789127382.446444:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 153 00010000:00010000:3.0:1789127382.452026:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127382.452947:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127382.452997:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127382.453080:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733887872 00000100:00100000:0.0:1789127382.453089:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733887872 00000100:00100000:0.0:1789127382.453141:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 11 00000100:00100000:0.0:1789127382.453151:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae919a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+40:2347:x1876035733887872:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789127382.453166:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789127382.453189:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728e00/0xeeacf7c024300ec9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d11 expref: 40 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.453206:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df782a68000) 00010000:00010000:0.0:1789127382.453211:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789127382.453255:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae919a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+39:2347:x1876035733887872:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 106us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127382.453263:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 11 00000100:00100000:3.0:1789127382.454071:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733888128 00000100:00100000:3.0:1789127382.454079:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733888128 00000100:00100000:3.0:1789127382.454120:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 42 00000100:00100000:3.0:1789127382.454128:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79a2c5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+39:11611:x1876035733888128:12345-192.168.206.40@tcp:35:cat.0 00000100:00100000:3.0:1789127382.454381:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79a2c5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+40:11611:x1876035733888128:12345-192.168.206.40@tcp:35:cat.0 Request processed in 253us (1440us total) trans 4294967439 rc 0/0 00000100:00100000:3.0:1789127382.454388:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 42 00000100:00100000:2.0:1789127382.521051:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127382.521120:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733888384 00000100:00100000:0.0:1789127382.521130:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733888384 00000100:00100000:0.0:1789127382.521189:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 154 00000100:00100000:0.0:1789127382.521198:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae9192c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+40:11617:x1876035733888384:12345-192.168.206.40@tcp:101:dd.0 00010000:00010000:0.0:1789127382.521221:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127382.521224:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789127382.521251:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728c00/0xeeacf7c024300e2f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7ce7 expref: 40 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.521288:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8df79f06cd00) 00010000:00010000:0.0:1789127382.521293:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789127382.521306:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728e00/0xeeacf7c024300ed7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7d18 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.521395:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728400/0xeeacf7c024300ede lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.521408:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c024300ead lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d0a expref: 40 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.521428:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728400/0xeeacf7c024300ede lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.521462:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c024300ead lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d0a expref: 40 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.521486:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c024300ead lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d0a expref: 40 pid: 5830 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127382.521500:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df787b8de00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5830:1876035752768384:192.168.206.40@tcp:104: 00000100:00100000:0.0:1789127382.521596:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7aeaaf180 going to sleep for 11 seconds 00000100:00100000:2.0:1789127382.525777:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127382.526012:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df787b8de00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5830:1876035752768384:192.168.206.40@tcp:104: 00010000:00010000:0.0:1789127382.526039:0:5830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728400/0xeeacf7c024300ede lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127382.526169:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733888512 00000100:00100000:1.0:1789127382.526175:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733888512 00010000:00010000:1.0:1789127382.526209:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c024300ead lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d0a expref: 41 pid: 5830 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127382.526244:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 71 00000100:00100000:1.0:1789127382.526252:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7889c8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+41:2349:x1876035733888512:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789127382.526265:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789127382.526272:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c024300ead lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d0a expref: 41 pid: 5830 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127382.526299:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c024300ead lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d0a expref: 41 pid: 5830 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127382.526320:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c024300ead lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d0a expref: 41 pid: 5830 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127382.526335:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df782a68000) 00010000:00010000:1.0:1789127382.526340:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728400/0xeeacf7c024300ede lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127382.526349:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728400/0xeeacf7c024300ede lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127382.526357:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728400/0xeeacf7c024300ede lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127382.526416:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789127382.526934:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7889c8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+40:2349:x1876035733888512:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 215us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127382.526946:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 71 00010000:00010000:3.0:1789127382.527172:0:5830:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728400/0xeeacf7c024300ede lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127382.527181:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728400/0xeeacf7c024300ede lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789127382.527198:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789127382.527348:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728e00/0xeeacf7c024300ed7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d18 expref: 41 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127382.527363:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728400/0xeeacf7c024300ede lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d18 expref: 40 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127382.527371:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df782a68000) 00010000:00010000:3.0:1789127382.527374:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789127382.527377:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7ae728400, rc 0) 00000100:00100000:3.0:1789127382.527459:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae9192c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+40:11617:x1876035733888384:12345-192.168.206.40@tcp:101:dd.0 Request processed in 6262us (6416us total) trans 4294967440 rc 0/0 00000100:00100000:3.0:1789127382.527477:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 154 00000100:00100000:2.0:1789127382.531093:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127382.531281:0:12098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733888768 00000100:00100000:0.0:1789127382.531303:0:12098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733888768 00000100:00100000:0.0:1789127382.531402:0:12098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 155 00000100:00100000:0.0:1789127382.531412:0:12098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae919a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+40:11617:x1876035733888768:12345-192.168.206.40@tcp:36:dd.0 00010000:00010000:0.0:1789127382.531902:0:12098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728c00/0xeeacf7c024300eec lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.531931:0:12098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728c00/0xeeacf7c024300eec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.531943:0:12098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728c00/0xeeacf7c024300eec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789127382.531994:0:12098:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967441 00000004:00010000:0.0:1789127382.532019:0:12098:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000008361c2e2 reply state 0000000028aa0f46 transno 4294967442 ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728c00/0xeeacf7c024300eec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127382.532027:0:12098:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789127382.532120:0:12098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae919a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+43:11617:x1876035733888768:12345-192.168.206.40@tcp:36:dd.0 Request processed in 708us (1330us total) trans 4294967442 rc 0/0 00000100:00100000:0.0:1789127382.532128:0:12098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 155 00000020:00080000:0.0:1789127382.532133:0:12098:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789127382.535281:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728c00/0xeeacf7c024300eec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127382.535298:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728c00/0xeeacf7c024300eec lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127382.535306:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728c00/0xeeacf7c024300eec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127382.535325:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7ae728c00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:3.0:1789127382.535330:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728c00/0xeeacf7c024300eec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127382.535337:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728c00/0xeeacf7c024300eec lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127382.535352:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df782a68000) 00010000:00010000:3.0:1789127382.535355:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127382.535359:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728c00/0xeeacf7c024300eec lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127382.535365:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728c00/0xeeacf7c024300eec lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127382.860469:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127382.867781:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733888896 00000100:00100000:0.0:1789127382.867820:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733888896 00000100:00100000:0.0:1789127382.867890:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 156 00000100:00100000:0.0:1789127382.867899:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeae6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+42:11631:x1876035733888896:12345-192.168.206.40@tcp:101:stat.0 00010000:00010000:0.0:1789127382.867924:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127382.867944:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729400/0xeeacf7c024300ef3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7d1f expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.868000:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c024300efa lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.868026:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c024300efa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.868039:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c024300efa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.868053:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729a00/0xeeacf7c024300f01 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.868060:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729a00/0xeeacf7c024300f01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.868066:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729a00/0xeeacf7c024300f01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.868151:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729800/0xeeacf7c024300f08 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.868161:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728400/0xeeacf7c024300ede lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d18 expref: 43 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.868170:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729800/0xeeacf7c024300f08 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.868198:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728400/0xeeacf7c024300ede lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d18 expref: 43 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.868212:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728400/0xeeacf7c024300ede lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d18 expref: 43 pid: 5830 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127382.868236:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df787b8de00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5831:1876035752768512:192.168.206.40@tcp:104: 00000100:00100000:0.0:1789127382.868334:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7aeaaf180 going to sleep for 11 seconds 00000100:00100000:0.0:1789127382.874147:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127382.875059:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733889152 00000100:00100000:3.0:1789127382.875082:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733889152 00000100:00100000:3.0:1789127382.875140:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 43 00000100:00100000:3.0:1789127382.875152:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df682e70780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+44:5588:x1876035733889152:12345-192.168.206.40@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789127382.875442:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df682e70780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+45:5588:x1876035733889152:12345-192.168.206.40@tcp:35:ldlm_bl.0 Request processed in 291us (1304us total) trans 4294967443 rc 0/0 00000100:00100000:3.0:1789127382.875451:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 43 00000100:00100000:2.0:1789127382.876282:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df787b8de00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5831:1876035752768512:192.168.206.40@tcp:104: 00010000:00010000:2.0:1789127382.876310:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729800/0xeeacf7c024300f08 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127382.881331:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127382.881465:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733889280 00000100:00100000:0.0:1789127382.881475:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733889280 00010000:00010000:0.0:1789127382.881516:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728400/0xeeacf7c024300ede lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d18 expref: 45 pid: 5830 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127382.881561:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 72 00000100:00100000:0.0:1789127382.881571:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae97b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+45:2348:x1876035733889280:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789127382.881585:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789127382.881592:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728400/0xeeacf7c024300ede lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d18 expref: 45 pid: 5830 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.881605:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728400/0xeeacf7c024300ede lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d18 expref: 45 pid: 5830 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.881636:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728400/0xeeacf7c024300ede lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d18 expref: 45 pid: 5830 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.881659:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df782a68000) 00010000:00010000:0.0:1789127382.881664:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729800/0xeeacf7c024300f08 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.881674:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729800/0xeeacf7c024300f08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.881697:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729800/0xeeacf7c024300f08 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127382.881727:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789127382.881776:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae97b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+44:2348:x1876035733889280:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 206us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127382.881784:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 72 00010000:00010000:3.0:1789127382.882303:0:5831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729800/0xeeacf7c024300f08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127382.882314:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729800/0xeeacf7c024300f08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789127382.882365:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1789127382.882370:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789127382.882389:0:5831:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729800/0xeeacf7c024300f08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127382.882401:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729800/0xeeacf7c024300f08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127382.882410:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c024300efa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127382.882416:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c024300efa lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127382.882423:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c024300efa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127382.882429:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7ae729e00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:3.0:1789127382.882433:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c024300efa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127382.882440:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c024300efa lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127382.882450:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8df79f06cd00) 00010000:00010000:3.0:1789127382.882453:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127382.882456:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c024300efa lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127382.882462:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c024300efa lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127382.882482:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729a00/0xeeacf7c024300f01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127382.882488:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729a00/0xeeacf7c024300f01 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127382.882493:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729a00/0xeeacf7c024300f01 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127382.882498:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7ae729a00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:3.0:1789127382.882501:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729a00/0xeeacf7c024300f01 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127382.882507:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729a00/0xeeacf7c024300f01 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127382.882515:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8df782a68d00) 00010000:00010000:3.0:1789127382.882517:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127382.882520:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729a00/0xeeacf7c024300f01 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127382.882526:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729a00/0xeeacf7c024300f01 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127382.882562:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729400/0xeeacf7c024300ef3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d1f expref: 44 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127382.882576:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729800/0xeeacf7c024300f08 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d1f expref: 43 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127382.882594:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df782a68000) 00010000:00010000:3.0:1789127382.882596:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789127382.882599:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7ae729800, rc 0) 00000100:00100000:3.0:1789127382.884002:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeae6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+43:11631:x1876035733888896:12345-192.168.206.40@tcp:101:stat.0 Request processed in 16094us (23532us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127382.884014:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 156 00000100:00100000:2.0:1789127382.956254:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127382.956397:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733889536 00000100:00100000:3.0:1789127382.956406:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733889536 00000100:00100000:3.0:1789127382.956512:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 157 00000100:00100000:3.0:1789127382.956524:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeae4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+43:11637:x1876035733889536:12345-192.168.206.40@tcp:36:truncate.0 00010000:00010000:3.0:1789127382.956579:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127382.956616:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729800/0xeeacf7c024300f08 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d1f expref: 43 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127382.956644:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df782a68000) 00010000:00010000:3.0:1789127382.956659:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789127382.957152:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c024300f0f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127382.957167:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c024300f0f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127382.957178:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c024300f0f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789127382.957231:0:5830:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967444 00000004:00010000:3.0:1789127382.957257:0:5830:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000020b9e307 reply state 0000000052608d20 transno 4294967445 ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c024300f0f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127382.957277:0:5830:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789127382.957376:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeae4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+45:11637:x1876035733889536:12345-192.168.206.40@tcp:36:truncate.0 Request processed in 853us (1129us total) trans 4294967445 rc 0/0 00000100:00100000:3.0:1789127382.957384:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 157 00000020:00080000:3.0:1789127382.957390:0:5830:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789127382.962304:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c024300f0f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127382.962323:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c024300f0f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127382.962330:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c024300f0f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127382.962336:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df798df0800 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:3.0:1789127382.962340:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c024300f0f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127382.962347:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c024300f0f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127382.962364:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df782a68000) 00010000:00010000:3.0:1789127382.962367:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127382.962371:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c024300f0f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127382.962378:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c024300f0f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127383.110842:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127383.110928:0:12098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733889664 00000100:00100000:0.0:1789127383.110937:0:12098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733889664 00000100:00100000:0.0:1789127383.111018:0:12098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 158 00000100:00100000:0.0:1789127383.111029:0:12098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeae52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+44:11651:x1876035733889664:12345-192.168.206.40@tcp:101:stat.0 00010000:00010000:0.0:1789127383.111053:0:12098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127383.111076:0:12098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728400/0xeeacf7c024300f16 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7d26 expref: -99 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.111156:0:12098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729800/0xeeacf7c024300f1d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.111171:0:12098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729800/0xeeacf7c024300f1d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.111182:0:12098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729800/0xeeacf7c024300f1d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.111196:0:12098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729400/0xeeacf7c024300f24 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.111204:0:12098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729400/0xeeacf7c024300f24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.111228:0:12098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729400/0xeeacf7c024300f24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.111322:0:12098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729a00/0xeeacf7c024300f2b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.111330:0:12098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729a00/0xeeacf7c024300f2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.111338:0:12098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729a00/0xeeacf7c024300f2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789127383.111369:0:12098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1789127383.111374:0:12098:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789127383.111394:0:12098:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729a00/0xeeacf7c024300f2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.111406:0:12098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729a00/0xeeacf7c024300f2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.111414:0:12098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729800/0xeeacf7c024300f1d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.111421:0:12098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729800/0xeeacf7c024300f1d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.111428:0:12098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729800/0xeeacf7c024300f1d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.111433:0:12098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7ae729800 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:0.0:1789127383.111437:0:12098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729800/0xeeacf7c024300f1d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.111451:0:12098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729800/0xeeacf7c024300f1d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.111464:0:12098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8df79f06cd00) 00010000:00010000:0.0:1789127383.111493:0:12098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127383.111498:0:12098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729800/0xeeacf7c024300f1d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.111504:0:12098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729800/0xeeacf7c024300f1d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.111517:0:12098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729400/0xeeacf7c024300f24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.111523:0:12098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729400/0xeeacf7c024300f24 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.111529:0:12098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729400/0xeeacf7c024300f24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.111533:0:12098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7ae729400 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:0.0:1789127383.111536:0:12098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729400/0xeeacf7c024300f24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.111541:0:12098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729400/0xeeacf7c024300f24 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.111547:0:12098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8df782a68700) 00010000:00010000:0.0:1789127383.111550:0:12098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127383.111552:0:12098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729400/0xeeacf7c024300f24 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.111569:0:12098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729400/0xeeacf7c024300f24 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.111599:0:12098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728400/0xeeacf7c024300f16 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d26 expref: 46 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.111613:0:12098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729a00/0xeeacf7c024300f2b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d26 expref: 45 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.111619:0:12098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df782a68000) 00010000:00010000:0.0:1789127383.111621:0:12098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789127383.111624:0:12098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7ae729a00, rc 0) 00000100:00100000:0.0:1789127383.111691:0:12098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeae52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+45:11651:x1876035733889664:12345-192.168.206.40@tcp:101:stat.0 Request processed in 665us (859us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127383.111698:0:12098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 158 00000100:00080000:1.0:1789127383.112567:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789127383.200875:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127383.200963:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733889920 00000100:00100000:3.0:1789127383.200984:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733889920 00000100:00100000:3.0:1789127383.201044:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 159 00000100:00100000:3.0:1789127383.201054:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79a3a0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+45:11660:x1876035733889920:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:3.0:1789127383.201074:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127383.201095:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c024300f32 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7d2d expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789127383.201211:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1789127383.201345:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c024300f32 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d2d expref: 47 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127383.201359:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df782a68a00) 00010000:00010000:3.0:1789127383.201362:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789127383.201368:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c024300f32 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d2d expref: 47 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127383.201383:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df798df0800, rc 0) 00000100:00100000:3.0:1789127383.201437:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79a3a0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+46:11660:x1876035733889920:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 384us (570us total) trans 4294967446 rc 301/301 00000100:00100000:3.0:1789127383.201444:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 159 00000100:00100000:1.0:1789127383.207094:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127383.207240:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733890176 00000100:00100000:3.0:1789127383.207249:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733890176 00000100:00100000:3.0:1789127383.207304:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 44 00000100:00100000:3.0:1789127383.207314:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df791569450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+46:11660:x1876035733890176:12345-192.168.206.40@tcp:35:lfs.0 00000100:00100000:3.0:1789127383.207560:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df791569450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+47:11660:x1876035733890176:12345-192.168.206.40@tcp:35:lfs.0 Request processed in 247us (475us total) trans 4294967447 rc 0/0 00000100:00100000:3.0:1789127383.207569:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 44 00000100:00100000:0.0:1789127383.266038:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127383.269239:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733890432 00000100:00100000:3.0:1789127383.269255:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733890432 00000100:00100000:3.0:1789127383.269335:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 160 00000100:00100000:3.0:1789127383.269346:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df682e71e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+47:11667:x1876035733890432:12345-192.168.206.40@tcp:101:bash.0 00010000:00010000:3.0:1789127383.269372:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127383.269405:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c024300f40 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7d34 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127383.269500:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024300f47 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127383.269515:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729a00/0xeeacf7c024300f2b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d26 expref: 48 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127383.269524:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024300f47 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127383.269556:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729a00/0xeeacf7c024300f2b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d26 expref: 48 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127383.269570:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729a00/0xeeacf7c024300f2b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d26 expref: 48 pid: 12098 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127383.269583:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae9792c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5830:1876035752768640:192.168.206.40@tcp:104: 00000100:00100000:3.0:1789127383.269684:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7b46be480 going to sleep for 11 seconds 00000100:00100000:1.0:1789127383.274833:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127383.274932:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733890560 00000100:00100000:2.0:1789127383.274946:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733890560 00010000:00010000:2.0:1789127383.274995:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729a00/0xeeacf7c024300f2b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d26 expref: 49 pid: 12098 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127383.275047:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 73 00000100:00100000:2.0:1789127383.275057:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79a3a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+49:2349:x1876035733890560:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789127383.275091:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789127383.275099:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729a00/0xeeacf7c024300f2b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d26 expref: 49 pid: 12098 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127383.275112:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729a00/0xeeacf7c024300f2b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d26 expref: 49 pid: 12098 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127383.275134:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df782a68000) 00010000:00010000:2.0:1789127383.275139:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024300f47 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127383.275147:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024300f47 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127383.275154:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024300f47 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127383.275174:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789127383.275240:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79a3a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+49:2349:x1876035733890560:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 184us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127383.275249:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 73 00010000:00010000:3.0:1789127383.275367:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729a00/0xeeacf7c024300f2b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d26 expref: 48 pid: 12098 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127383.275393:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae9792c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5830:1876035752768640:192.168.206.40@tcp:104: 00010000:00010000:3.0:1789127383.275435:0:5830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024300f47 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127383.275446:0:5830:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024300f47 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127383.275566:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024300f47 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789127383.275597:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:3.0:1789127383.275896:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c024300f40 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d34 expref: 49 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127383.275921:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024300f47 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d34 expref: 48 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127383.275930:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df782a68000) 00010000:00010000:3.0:1789127383.275933:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789127383.275937:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df798df0200, rc 0) 00000100:00100000:3.0:1789127383.275990:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df682e71e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+48:11667:x1876035733890432:12345-192.168.206.40@tcp:101:bash.0 Request processed in 6645us (9962us total) trans 4294967448 rc 0/0 00000100:00100000:3.0:1789127383.275999:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 160 00000100:00100000:1.0:1789127383.285910:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127383.286002:0:10285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733890816 00000100:00100000:2.0:1789127383.286015:0:10285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733890816 00000100:00100000:2.0:1789127383.286091:0:10285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 161 00000100:00100000:2.0:1789127383.286102:0:10285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79a3a1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+48:11667:x1876035733890816:12345-192.168.206.40@tcp:36:bash.0 00010000:00010000:2.0:1789127383.286363:0:10285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c800/0xeeacf7c024300f55 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127383.286772:0:10285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c800/0xeeacf7c024300f55 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127383.286837:0:10285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c800/0xeeacf7c024300f55 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789127383.286893:0:10285:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967449 00000004:00010000:2.0:1789127383.286922:0:10285:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000095dd62b2 reply state 00000000b73718be transno 4294967450 ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c800/0xeeacf7c024300f55 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127383.286931:0:10285:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789127383.287038:0:10285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79a3a1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+51:11667:x1876035733890816:12345-192.168.206.40@tcp:36:bash.0 Request processed in 936us (1139us total) trans 4294967450 rc 0/0 00000100:00100000:2.0:1789127383.287047:0:10285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 161 00000020:00080000:2.0:1789127383.287052:0:10285:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789127383.293171:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c800/0xeeacf7c024300f55 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127383.293187:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c800/0xeeacf7c024300f55 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127383.293193:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c800/0xeeacf7c024300f55 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127383.293215:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df79032c800 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:3.0:1789127383.293220:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c800/0xeeacf7c024300f55 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127383.293227:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c800/0xeeacf7c024300f55 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127383.293243:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df782a68000) 00010000:00010000:3.0:1789127383.293246:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127383.293250:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c800/0xeeacf7c024300f55 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127383.293257:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c800/0xeeacf7c024300f55 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127383.300519:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127383.300854:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733890944 00000100:00100000:2.0:1789127383.300864:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733890944 00000100:00100000:2.0:1789127383.300922:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 162 00000100:00100000:2.0:1789127383.300932:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79a3a03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+50:11667:x1876035733890944:12345-192.168.206.40@tcp:101:bash.0 00010000:00010000:2.0:1789127383.300954:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127383.300973:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c400/0xeeacf7c024300f5c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7d3b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127383.301045:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c024300f63 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127383.301059:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024300f47 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d34 expref: 51 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127383.301067:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c024300f63 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127383.301116:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024300f47 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d34 expref: 51 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127383.301130:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024300f47 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d34 expref: 51 pid: 5830 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127383.301145:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df787b8de00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1876035752768768:192.168.206.40@tcp:104: 00000100:00100000:2.0:1789127383.301227:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df791c473c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789127383.306784:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df787b8de00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1876035752768768:192.168.206.40@tcp:104: 00010000:00010000:2.0:1789127383.306840:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c024300f63 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127383.307127:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127383.309801:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733891072 00000100:00100000:0.0:1789127383.309814:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733891072 00010000:00010000:0.0:1789127383.309861:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024300f47 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d34 expref: 52 pid: 5830 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127383.309969:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 74 00000100:00100000:0.0:1789127383.309979:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeab8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+52:2348:x1876035733891072:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789127383.309995:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789127383.310002:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024300f47 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d34 expref: 52 pid: 5830 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.310032:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024300f47 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d34 expref: 52 pid: 5830 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.310053:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024300f47 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d34 expref: 52 pid: 5830 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.310083:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df782a68000) 00010000:00010000:0.0:1789127383.310089:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c024300f63 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.310098:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c024300f63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.310106:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c024300f63 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.310141:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789127383.310202:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeab8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+51:2348:x1876035733891072:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 224us (3075us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127383.310210:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 74 00010000:00010000:3.0:1789127383.310277:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c024300f63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127383.310285:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c024300f63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789127383.310329:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1789127383.310333:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789127383.310351:0:5832:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c024300f63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127383.310388:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c400/0xeeacf7c024300f5c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d3b expref: 51 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127383.310402:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c024300f63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d3b expref: 50 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127383.310417:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df782a68000) 00010000:00010000:3.0:1789127383.310420:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789127383.310422:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df79032c200, rc 0) 00000100:00100000:3.0:1789127383.310448:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79a3a03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+50:11667:x1876035733890944:12345-192.168.206.40@tcp:101:bash.0 Request processed in 9518us (9938us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127383.310465:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 162 00000100:00100000:1.0:1789127383.318883:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127383.318979:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733891328 00000100:00100000:3.0:1789127383.318988:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733891328 00000100:00100000:3.0:1789127383.319035:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 45 00000100:00100000:3.0:1789127383.319045:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeaba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+50:11667:x1876035733891328:12345-192.168.206.40@tcp:35:bash.0 00000100:00100000:3.0:1789127383.319369:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeaba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+51:11667:x1876035733891328:12345-192.168.206.40@tcp:35:bash.0 Request processed in 324us (493us total) trans 4294967451 rc 0/0 00000100:00100000:3.0:1789127383.319378:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 45 00000100:00100000:1.0:1789127383.417084:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127383.417170:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733891584 00000100:00100000:3.0:1789127383.417180:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733891584 00000100:00100000:3.0:1789127383.417236:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 163 00000100:00100000:3.0:1789127383.417246:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bbd85a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+51:11677:x1876035733891584:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:3.0:1789127383.417270:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127383.417289:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c024300f6a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7d42 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789127383.417407:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1789127383.417520:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c024300f6a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d42 expref: 53 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127383.417552:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df782a68a00) 00010000:00010000:3.0:1789127383.417555:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789127383.417560:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c024300f6a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d42 expref: 53 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127383.417576:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df798df0800, rc 0) 00000100:00100000:3.0:1789127383.417645:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bbd85a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+52:11677:x1876035733891584:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 401us (570us total) trans 4294967452 rc 301/301 00000100:00100000:3.0:1789127383.417663:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 163 00000100:00100000:1.0:1789127383.420976:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127383.421046:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733891712 00000100:00100000:3.0:1789127383.421055:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733891712 00000100:00100000:3.0:1789127383.421110:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 164 00000100:00100000:3.0:1789127383.421120:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79206e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+52:11677:x1876035733891712:12345-192.168.206.40@tcp:34:lfs.0 00010000:00010000:3.0:1789127383.421186:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024300f78 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127383.421202:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024300f78 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127383.421213:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024300f78 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127383.421227:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024300f7f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127383.421234:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024300f7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127383.421256:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024300f7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127383.421339:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c024300f86 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127383.421348:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c024300f86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127383.421355:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c024300f86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789127383.421389:0:5831:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c024300f86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127383.421401:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024300f78 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127383.421407:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024300f78 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127383.421414:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024300f78 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127383.421420:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df798df0200 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:3.0:1789127383.421424:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024300f78 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127383.421443:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024300f78 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127383.421455:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8df79f06cd00) 00010000:00010000:3.0:1789127383.421463:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127383.421468:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024300f78 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127383.421474:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024300f78 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127383.421490:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024300f7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127383.421495:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024300f7f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127383.421501:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024300f7f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127383.421505:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df798df1c00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:3.0:1789127383.421508:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024300f7f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127383.421513:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024300f7f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127383.421519:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8df79f06c600) 00010000:00010000:3.0:1789127383.421522:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127383.421524:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024300f7f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127383.421529:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024300f7f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127383.421543:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c024300f86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127383.421557:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c024300f86 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127383.421562:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c024300f86 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127383.421567:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df798df1e00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:3.0:1789127383.421570:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c024300f86 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127383.421577:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c024300f86 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127383.421585:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df782a68000) 00010000:00010000:3.0:1789127383.421587:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127383.421600:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c024300f86 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127383.421607:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c024300f86 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127383.421698:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79206e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+52:11677:x1876035733891712:12345-192.168.206.40@tcp:34:lfs.0 Request processed in 578us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127383.421706:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 164 00000100:00100000:1.0:1789127383.423292:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127383.423351:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733891968 00000100:00100000:3.0:1789127383.423359:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733891968 00000100:00100000:3.0:1789127383.423409:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 46 00000100:00100000:3.0:1789127383.423417:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79062e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+52:11677:x1876035733891968:12345-192.168.206.40@tcp:35:lfs.0 00000100:00100000:3.0:1789127383.423921:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79062e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+53:11677:x1876035733891968:12345-192.168.206.40@tcp:35:lfs.0 Request processed in 502us (632us total) trans 4294967453 rc 0/0 00000100:00100000:3.0:1789127383.423941:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 46 00000100:00100000:1.0:1789127383.476181:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00010000:00010000:1.0:1789127383.477735:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127383.484215:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733892224 00000100:00100000:3.0:1789127383.484228:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733892224 00000100:00100000:2.0:1789127383.484370:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 165 00000100:00100000:2.0:1789127383.484381:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79062e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+53:11680:x1876035733892224:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:2.0:1789127383.484404:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127383.484424:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c400/0xeeacf7c024300f8d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7d49 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127383.484488:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c800/0xeeacf7c024300f94 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127383.484502:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c800/0xeeacf7c024300f94 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127383.484512:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c800/0xeeacf7c024300f94 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127383.484543:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032ca00/0xeeacf7c024300f9b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127383.484550:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032ca00/0xeeacf7c024300f9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127383.484557:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032ca00/0xeeacf7c024300f9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127383.484693:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7200/0xeeacf7c024300fa2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127383.484702:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7200/0xeeacf7c024300fa2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127383.484721:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7200/0xeeacf7c024300fa2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789127383.484732:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1789127383.484965:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c800/0xeeacf7c024300f94 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127383.484972:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c800/0xeeacf7c024300f94 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127383.484978:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c800/0xeeacf7c024300f94 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127383.485059:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df79032c800 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:2.0:1789127383.485064:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c800/0xeeacf7c024300f94 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127383.485082:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c800/0xeeacf7c024300f94 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127383.485240:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8df79f06cd00) 00010000:00010000:2.0:1789127383.485244:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789127383.485250:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c800/0xeeacf7c024300f94 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127383.485257:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c800/0xeeacf7c024300f94 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127383.485270:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032ca00/0xeeacf7c024300f9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127383.485276:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032ca00/0xeeacf7c024300f9b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127383.485281:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032ca00/0xeeacf7c024300f9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127383.485286:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df79032ca00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:2.0:1789127383.485288:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032ca00/0xeeacf7c024300f9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127383.485294:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032ca00/0xeeacf7c024300f9b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127383.485301:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8df7906f6500) 00010000:00010000:2.0:1789127383.485304:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789127383.485307:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032ca00/0xeeacf7c024300f9b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127383.485323:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032ca00/0xeeacf7c024300f9b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127383.485365:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c400/0xeeacf7c024300f8d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d49 expref: 56 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127383.485378:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7200/0xeeacf7c024300fa2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d49 expref: 55 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127383.485386:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df782a68000) 00010000:00010000:2.0:1789127383.485388:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789127383.485390:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7aeab7200, rc 0) 00000100:00100000:2.0:1789127383.485499:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79062e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+55:11680:x1876035733892224:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 1119us (9325us total) trans 4294967454 rc 0/0 00000100:00100000:2.0:1789127383.485508:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 165 00000100:00100000:1.0:1789127383.503194:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127383.503246:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127383.503350:0:10285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733892480 00000100:00100000:2.0:1789127383.503363:0:10285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733892480 00000100:00100000:2.0:1789127383.503461:0:10285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 166 00000100:00100000:2.0:1789127383.503482:0:10285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79062f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+55:11680:x1876035733892480:12345-192.168.206.40@tcp:54:lfs.0 00010000:00010000:2.0:1789127383.503566:0:10285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6a00/0xeeacf7c024300fb0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127383.503586:0:10285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6a00/0xeeacf7c024300fb0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127383.503613:0:10285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6a00/0xeeacf7c024300fb0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127383.503670:0:10285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6a00/0xeeacf7c024300fb0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127383.503678:0:10285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6a00/0xeeacf7c024300fb0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127383.503685:0:10285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6a00/0xeeacf7c024300fb0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127383.503691:0:10285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7aeab6a00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:2.0:1789127383.503696:0:10285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6a00/0xeeacf7c024300fb0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127383.503704:0:10285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6a00/0xeeacf7c024300fb0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127383.503718:0:10285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df782a68000) 00010000:00010000:2.0:1789127383.503720:0:10285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789127383.503725:0:10285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6a00/0xeeacf7c024300fb0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127383.503731:0:10285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6a00/0xeeacf7c024300fb0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127383.503840:0:10285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79062f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+55:11680:x1876035733892480:12345-192.168.206.40@tcp:54:lfs.0 Request processed in 369us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127383.503849:0:10285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 166 00000100:00100000:3.0:1789127383.504192:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733892352 00000100:00100000:3.0:1789127383.504198:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733892352 00000100:00100000:3.0:1789127383.504239:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 12 00000100:00100000:3.0:1789127383.504246:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79062c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+55:2346:x1876035733892352:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789127383.504257:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127383.504272:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7200/0xeeacf7c024300fa2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d49 expref: 55 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127383.504284:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df782a68000) 00010000:00010000:3.0:1789127383.504287:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127383.504309:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79062c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+54:2346:x1876035733892352:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 64us (1063us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127383.504315:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 12 00000100:00100000:1.0:1789127383.508725:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127383.508845:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733892736 00000100:00100000:2.0:1789127383.508855:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733892736 00000100:00100000:2.0:1789127383.508975:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 47 00000100:00100000:2.0:1789127383.508995:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df78efce940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+54:11680:x1876035733892736:12345-192.168.206.40@tcp:35:lfs.0 00000100:00100000:2.0:1789127383.509224:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df78efce940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+55:11680:x1876035733892736:12345-192.168.206.40@tcp:35:lfs.0 Request processed in 230us (506us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1789127383.509232:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 47 00000100:00100000:1.0:1789127383.675950:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127383.678571:0:12098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733892992 00000100:00100000:0.0:1789127383.678584:0:12098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733892992 00000100:00100000:0.0:1789127383.678733:0:12098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 167 00000100:00100000:0.0:1789127383.678744:0:12098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7af7cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+55:11698:x1876035733892992:12345-192.168.206.40@tcp:101:cat.0 00010000:00010000:0.0:1789127383.678767:0:12098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127383.678802:0:12098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729400/0xeeacf7c024300fb7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7d50 expref: -99 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.678923:0:12098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729800/0xeeacf7c024300fbe lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.678937:0:12098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729800/0xeeacf7c024300fbe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.678948:0:12098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729800/0xeeacf7c024300fbe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789127383.678959:0:12098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1789127383.679081:0:12098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729400/0xeeacf7c024300fb7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d50 expref: 58 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.679098:0:12098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729800/0xeeacf7c024300fbe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d50 expref: 57 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.679107:0:12098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df782a68000) 00010000:00010000:0.0:1789127383.679110:0:12098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789127383.679113:0:12098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7ae729800, rc 0) 00000100:00100000:0.0:1789127383.679184:0:12098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7af7cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+57:11698:x1876035733892992:12345-192.168.206.40@tcp:101:cat.0 Request processed in 442us (3243us total) trans 4294967456 rc 0/0 00000100:00100000:0.0:1789127383.679191:0:12098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 167 00000100:00100000:1.0:1789127383.722198:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127383.722311:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733893120 00000100:00100000:3.0:1789127383.722319:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733893120 00000100:00100000:3.0:1789127383.722379:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 168 00000100:00100000:3.0:1789127383.722389:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7af7cda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+57:11699:x1876035733893120:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:3.0:1789127383.722425:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127383.722468:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c024300fcc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7d57 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127383.722529:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024300fd3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127383.722562:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024300fd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127383.722575:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024300fd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789127383.722656:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:3.0:1789127383.722660:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1789127383.722696:0:5830:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024300fd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127383.722722:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c024300fcc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d57 expref: 59 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127383.722739:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024300fd3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d57 expref: 58 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127383.722746:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8df79f06cd00) 00010000:00010000:3.0:1789127383.722749:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789127383.722752:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df798df1c00, rc 0) 00000100:00100000:3.0:1789127383.722862:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7af7cda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+58:11699:x1876035733893120:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 474us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127383.722869:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 168 00000100:00100000:1.0:1789127383.748542:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127383.749184:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733893504 00000100:00100000:3.0:1789127383.749194:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733893504 00000100:00100000:3.0:1789127383.749255:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 48 00000100:00100000:3.0:1789127383.749266:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7af7cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+58:11699:x1876035733893504:12345-192.168.206.40@tcp:35:lfs.0 00000100:00100000:3.0:1789127383.749665:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7af7cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+59:11699:x1876035733893504:12345-192.168.206.40@tcp:35:lfs.0 Request processed in 400us (1133us total) trans 4294967457 rc 0/0 00000100:00100000:3.0:1789127383.749686:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 48 00000100:00100000:0.0:1789127383.754239:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127383.754343:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733893632 00000100:00100000:2.0:1789127383.754352:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733893632 00000100:00100000:2.0:1789127383.754439:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 13 00000100:00100000:2.0:1789127383.754448:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df682e72580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+59:11699:x1876035733893632:12345-192.168.206.40@tcp:103:lfs.0 00010000:00010000:2.0:1789127383.754462:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789127383.754483:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032c200/0xeeacf7c024300f63 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d3b expref: 59 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127383.754500:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729800/0xeeacf7c024300fbe lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d50 expref: 58 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127383.754510:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729200/0xeeacf7c024300e6e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7cfc expref: 57 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127383.754519:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df782a68000) 00010000:00010000:2.0:1789127383.754529:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789127383.754581:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df682e72580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+56:11699:x1876035733893632:12345-192.168.206.40@tcp:103:lfs.0 Request processed in 133us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127383.755409:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 13 00000100:00100000:1.0:1789127383.764900:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127383.766967:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733893760 00000100:00100000:0.0:1789127383.766980:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733893760 00000100:00100000:0.0:1789127383.767056:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 169 00000100:00100000:0.0:1789127383.767067:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7af7cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+56:11699:x1876035733893760:12345-192.168.206.40@tcp:58:lfs.0 00010000:00010000:0.0:1789127383.767356:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c024300fda lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.767375:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c024300fda lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.767387:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c024300fda lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789127383.768187:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:0.0:1789127383.768276:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7af7cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+56:11699:x1876035733893760:12345-192.168.206.40@tcp:58:lfs.0 Request processed in 1209us (3382us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127383.768286:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 169 00000100:00100000:1.0:1789127383.810921:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127383.811020:0:12098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733893888 00000100:00100000:0.0:1789127383.811029:0:12098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733893888 00000100:00100000:0.0:1789127383.811081:0:12098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 170 00000100:00100000:0.0:1789127383.811090:0:12098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7af7ccb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+56:11701:x1876035733893888:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:0.0:1789127383.811108:0:12098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127383.811128:0:12098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728c00/0xeeacf7c024300fe1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7d5e expref: -99 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.811206:0:12098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c024300fe8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.811218:0:12098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c024300fe8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.811227:0:12098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c024300fe8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.811286:0:12098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728e00/0xeeacf7c024300fef lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.811294:0:12098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728e00/0xeeacf7c024300fef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.811299:0:12098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728e00/0xeeacf7c024300fef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.811388:0:12098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729000/0xeeacf7c024300ff6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.811396:0:12098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729000/0xeeacf7c024300ff6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.811404:0:12098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729000/0xeeacf7c024300ff6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789127383.811438:0:12098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1789127383.811442:0:12098:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789127383.811459:0:12098:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729000/0xeeacf7c024300ff6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.811470:0:12098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729000/0xeeacf7c024300ff6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.811478:0:12098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c024300fe8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.811484:0:12098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c024300fe8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.811500:0:12098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c024300fe8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.811506:0:12098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7ae729c00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:0.0:1789127383.811511:0:12098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c024300fe8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.811519:0:12098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c024300fe8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.811531:0:12098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8df79f06cd00) 00010000:00010000:0.0:1789127383.811534:0:12098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127383.811538:0:12098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c024300fe8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.811544:0:12098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c024300fe8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.811557:0:12098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728e00/0xeeacf7c024300fef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.811563:0:12098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728e00/0xeeacf7c024300fef lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.811568:0:12098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728e00/0xeeacf7c024300fef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.811572:0:12098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7ae728e00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:0.0:1789127383.811575:0:12098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728e00/0xeeacf7c024300fef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.811591:0:12098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728e00/0xeeacf7c024300fef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.811599:0:12098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8df782a68f00) 00010000:00010000:0.0:1789127383.811602:0:12098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127383.811604:0:12098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728e00/0xeeacf7c024300fef lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.811610:0:12098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728e00/0xeeacf7c024300fef lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.811666:0:12098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728c00/0xeeacf7c024300fe1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d5e expref: 58 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.811680:0:12098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729000/0xeeacf7c024300ff6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d5e expref: 57 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.811687:0:12098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df782a68700) 00010000:00010000:0.0:1789127383.811689:0:12098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789127383.811692:0:12098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7ae729000, rc 0) 00000100:00100000:0.0:1789127383.811750:0:12098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7af7ccb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+57:11701:x1876035733893888:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 661us (837us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127383.811758:0:12098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 170 00000040:00080000:2.0:1789127383.859062:0:12084:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789127383.859071:0:12084:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789127383.859124:0:12084:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:2.0:1789127383.859135:0:12084:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789127383.859245:0:12084:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df787b8de00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12084:1876035752768896:192.168.206.40@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789127383.859360:0:12084:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df791c47180 going to sleep for 11 seconds 00000100:00100000:2.0:1789127383.861098:0:12084:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df787b8de00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12084:1876035752768896:192.168.206.40@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789127383.862542:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127383.863172:0:10285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733894016 00000100:00100000:3.0:1789127383.863181:0:10285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733894016 00000100:00100000:3.0:1789127383.863239:0:10285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 171 00000100:00100000:3.0:1789127383.863249:0:10285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b43152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+57:11712:x1876035733894016:12345-192.168.206.40@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789127383.863281:0:10285:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789127383.863570:0:10285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b43152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+57:11712:x1876035733894016:12345-192.168.206.40@tcp:53:lhsmtool_posix.0 Request processed in 321us (1032us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127383.863578:0:10285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 171 00000100:00100000:3.0:1789127383.866254:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127383.866407:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733894144 00000100:00100000:2.0:1789127383.866416:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733894144 00000100:00100000:2.0:1789127383.866610:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 172 00000100:00100000:2.0:1789127383.866769:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae9792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+57:11712:x1876035733894144:12345-192.168.206.40@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789127383.866896:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6200/0xeeacf7c024300ffd lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127383.866914:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6200/0xeeacf7c024300ffd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127383.866930:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6200/0xeeacf7c024300ffd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127383.866945:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7c00/0xeeacf7c024301004 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127383.866952:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7c00/0xeeacf7c024301004 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127383.866959:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7c00/0xeeacf7c024301004 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127383.866984:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7800/0xeeacf7c02430100b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127383.866992:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7800/0xeeacf7c02430100b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127383.867007:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7800/0xeeacf7c02430100b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789127383.867048:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1789127383.867053:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789127383.867064:0:5831:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7800/0xeeacf7c02430100b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127383.867076:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6200/0xeeacf7c024300ffd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127383.867083:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6200/0xeeacf7c024300ffd lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127383.867090:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6200/0xeeacf7c024300ffd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127383.867096:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7aeab6200 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:2.0:1789127383.867100:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6200/0xeeacf7c024300ffd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127383.867107:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6200/0xeeacf7c024300ffd lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127383.867118:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8df79f06c900) 00010000:00010000:2.0:1789127383.867121:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789127383.867126:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6200/0xeeacf7c024300ffd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127383.867133:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6200/0xeeacf7c024300ffd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127383.867154:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7c00/0xeeacf7c024301004 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127383.867161:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7c00/0xeeacf7c024301004 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127383.867167:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7c00/0xeeacf7c024301004 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127383.867173:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7aeab7c00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:2.0:1789127383.867176:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7c00/0xeeacf7c024301004 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127383.867182:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7c00/0xeeacf7c024301004 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127383.867191:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff8df7906f6500) 00010000:00010000:2.0:1789127383.867193:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789127383.867196:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7c00/0xeeacf7c024301004 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127383.867202:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7c00/0xeeacf7c024301004 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127383.867215:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7800/0xeeacf7c02430100b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127383.867221:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7800/0xeeacf7c02430100b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127383.867227:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7800/0xeeacf7c02430100b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127383.867237:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7aeab7800 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:2.0:1789127383.867241:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7800/0xeeacf7c02430100b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127383.867247:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7800/0xeeacf7c02430100b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127383.867256:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df782a68700) 00010000:00010000:2.0:1789127383.867259:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789127383.867262:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7800/0xeeacf7c02430100b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127383.867268:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7800/0xeeacf7c02430100b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127383.867396:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae9792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+57:11712:x1876035733894144:12345-192.168.206.40@tcp:34:lhsmtool_posix.0 Request processed in 630us (1149us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127383.868375:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 172 00000100:00100000:2.0:1789127383.869883:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127383.869960:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733894400 00000100:00100000:3.0:1789127383.869969:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733894400 00000100:00100000:3.0:1789127383.870023:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 173 00000100:00100000:3.0:1789127383.870032:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df682c72940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+57:11712:x1876035733894400:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789127383.870052:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127383.870070:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c024301012 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7d65 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127383.870156:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024301019 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127383.870170:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024301019 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127383.870181:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024301019 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789127383.870203:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1789127383.870295:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024301019 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127383.870303:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024301019 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127383.870310:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024301019 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127383.870317:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df798df0200 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:3.0:1789127383.870321:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024301019 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127383.870329:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024301019 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127383.870341:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df782a68700) 00010000:00010000:3.0:1789127383.870344:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789127383.870349:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024301019 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127383.870355:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024301019 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127383.870397:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c024301012 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d65 expref: 59 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127383.870408:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8df79f06c900) 00010000:00010000:3.0:1789127383.870410:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789127383.870420:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c024301012 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d65 expref: 59 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127383.870448:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df798df1e00, rc 0) 00000100:00100000:3.0:1789127383.870499:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df682c72940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+58:11712:x1876035733894400:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 Request processed in 467us (623us total) trans 4294967458 rc 301/301 00000100:00100000:3.0:1789127383.870507:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 173 00000100:00100000:3.0:1789127383.873717:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127383.874161:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733894528 00000100:00100000:0.0:1789127383.874170:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733894528 00000100:00100000:0.0:1789127383.874256:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 174 00000100:00100000:0.0:1789127383.874265:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae978000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+58:11712:x1876035733894528:12345-192.168.206.40@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789127383.874304:0:5832:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789127383.874408:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae978000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+58:11712:x1876035733894528:12345-192.168.206.40@tcp:53:lhsmtool_posix.0 Request processed in 144us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127383.874415:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 174 00000100:00100000:3.0:1789127383.876831:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127383.877478:0:12098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733894784 00000100:00100000:2.0:1789127383.877487:0:12098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733894784 00000100:00100000:2.0:1789127383.877542:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 175 00000100:00100000:2.0:1789127383.877551:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae9783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+58:11712:x1876035733894784:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789127383.877570:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127383.877573:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789127383.877780:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024300fd3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d57 expref: 58 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127383.877824:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8df79f06cd00) 00010000:00010000:2.0:1789127383.877829:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789127383.877842:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6400/0xeeacf7c024301027 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7d6c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789127383.878185:0:5830:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:2.0:1789127383.878348:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7a00/0xeeacf7c02430102e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127383.878362:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7a00/0xeeacf7c02430102e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127383.878371:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7a00/0xeeacf7c02430102e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127383.878412:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6400/0xeeacf7c024301027 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d6c expref: 60 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127383.878426:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7a00/0xeeacf7c02430102e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d6c expref: 59 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127383.878499:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8df7906f6200) 00010000:00010000:2.0:1789127383.878502:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789127383.878505:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7aeab7a00, rc 0) 00000100:00100000:2.0:1789127383.878558:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae9783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+59:11712:x1876035733894784:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 Request processed in 1007us (1732us total) trans 4294967459 rc 0/0 00000100:00100000:2.0:1789127383.878566:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 175 00000100:00100000:2.0:1789127383.881024:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127383.881105:0:10285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733895040 00000100:00100000:0.0:1789127383.881112:0:10285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733895040 00000100:00100000:0.0:1789127383.881160:0:10285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 176 00000100:00100000:0.0:1789127383.881169:0:10285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df682c72580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+59:11712:x1876035733895040:12345-192.168.206.40@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789127383.881216:0:10285:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789127383.881240:0:10285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7a00/0xeeacf7c02430102e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d6c expref: 59 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.881255:0:10285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8df7906f6200) 00010000:00010000:0.0:1789127383.881265:0:10285:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789127383.881285:0:10285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728e00/0xeeacf7c02430103c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.881297:0:10285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728e00/0xeeacf7c02430103c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.881307:0:10285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728e00/0xeeacf7c02430103c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.881321:0:10285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c024301043 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x2b720a86 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.881328:0:10285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c024301043 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x2b720a86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.881348:0:10285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c024301043 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x2b720a86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.881412:0:10285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728e00/0xeeacf7c02430103c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.881420:0:10285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728e00/0xeeacf7c02430103c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.881426:0:10285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728e00/0xeeacf7c02430103c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.881431:0:10285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7ae728e00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:0.0:1789127383.881434:0:10285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728e00/0xeeacf7c02430103c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.881441:0:10285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728e00/0xeeacf7c02430103c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.881449:0:10285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8df79f06cd00) 00010000:00010000:0.0:1789127383.881452:0:10285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127383.881456:0:10285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728e00/0xeeacf7c02430103c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.881462:0:10285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728e00/0xeeacf7c02430103c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.881471:0:10285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c024301043 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x2b720a86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.881477:0:10285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c024301043 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x2b720a86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.881488:0:10285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c024301043 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x2b720a86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.881494:0:10285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7ae729c00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:0.0:1789127383.881497:0:10285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c024301043 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x2b720a86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.881503:0:10285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c024301043 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x2b720a86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.881511:0:10285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x2b720a86 (ffff8df782a68f00) 00010000:00010000:0.0:1789127383.881514:0:10285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127383.881517:0:10285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c024301043 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x2b720a86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.881522:0:10285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c024301043 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x2b720a86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127383.881600:0:10285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df682c72580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+58:11712:x1876035733895040:12345-192.168.206.40@tcp:36:lhsmtool_posix.0 Request processed in 430us (582us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789127383.881607:0:10285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 176 00000100:00100000:2.0:1789127383.884684:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127383.884767:0:12098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733895168 00000100:00100000:3.0:1789127383.884776:0:12098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733895168 00000100:00100000:3.0:1789127383.884846:0:12098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 177 00000100:00100000:3.0:1789127383.884855:0:12098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df682c73840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+58:11712:x1876035733895168:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789127383.884872:0:12098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127383.884893:0:12098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c02430104a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7d73 expref: -99 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127383.884925:0:12098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024301051 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127383.884937:0:12098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024301051 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127383.884948:0:12098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024301051 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127383.885029:0:12098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c02430104a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d73 expref: 60 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127383.885055:0:12098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024301051 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d73 expref: 59 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127383.885065:0:12098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8df79f06c600) 00010000:00010000:3.0:1789127383.885068:0:12098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789127383.885071:0:12098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df798df0200, rc 0) 00000100:00100000:3.0:1789127383.885123:0:12098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df682c73840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+59:11712:x1876035733895168:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 Request processed in 269us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127383.885917:0:12098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 177 00000100:00100000:2.0:1789127383.888287:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127383.888396:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733895424 00000100:00100000:3.0:1789127383.888404:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733895424 00000100:00100000:3.0:1789127383.888456:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 178 00000100:00100000:3.0:1789127383.888465:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df682c70b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+59:11712:x1876035733895424:12345-192.168.206.40@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789127383.888540:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c024301058 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127383.888556:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c024301058 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127383.888567:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c024301058 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789127383.888862:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:3.0:1789127383.888873:0:5831:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 330045083433ns, next at 331045080616ns, rc = 0 00000004:00010000:3.0:1789127383.888954:0:5831:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000060d3e584 reply state 000000008f3fd8c0 transno 4294967460 ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c024301058 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127383.888974:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789127383.889060:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df682c70b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+61:11712:x1876035733895424:12345-192.168.206.40@tcp:36:lhsmtool_posix.0 Request processed in 595us (777us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1789127383.889068:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 178 00010000:00010000:3.0:1789127383.891016:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c024301058 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127383.891031:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c024301058 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127383.891039:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c024301058 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127383.891045:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df798df0800 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:3.0:1789127383.891049:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c024301058 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127383.891057:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c024301058 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127383.891073:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8df79f06c600) 00010000:00010000:3.0:1789127383.891076:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789127383.891081:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c024301058 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127383.891087:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c024301058 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127383.892612:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127383.892773:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733895552 00000100:00100000:0.0:1789127383.892782:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733895552 00000100:00100000:0.0:1789127383.892870:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 179 00000100:00100000:0.0:1789127383.892881:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df682c730c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+60:11712:x1876035733895552:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789127383.892903:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127383.892920:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c02430105f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7d7a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.892986:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c02430105f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d7a expref: 61 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.892999:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c02430105f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d7a expref: 61 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.893015:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8df79f06c600) 00010000:00010000:0.0:1789127383.893017:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789127383.893021:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7ae729c00, rc 0) 00000100:00100000:0.0:1789127383.893081:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df682c730c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+61:11712:x1876035733895552:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 Request processed in 201us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127383.893089:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 179 00000100:00100000:2.0:1789127383.895312:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127383.895386:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733895680 00000100:00100000:3.0:1789127383.895394:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733895680 00000100:00100000:3.0:1789127383.895471:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 50 00000100:00100000:3.0:1789127383.895480:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df682c71e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+6:2349:x1876035733895680:12345-192.168.206.40@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1789127383.895834:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df682c71e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+7:2349:x1876035733895680:12345-192.168.206.40@tcp:2:lhsmtool_posix.0 Request processed in 354us (528us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1789127383.895842:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 50 00000100:00080000:2.0:1789127383.896004:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789127383.898172:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127383.898262:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733895936 00000100:00100000:3.0:1789127383.898269:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733895936 00000100:00100000:3.0:1789127383.898318:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 49 00000100:00100000:3.0:1789127383.898326:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b43170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+61:11712:x1876035733895936:12345-192.168.206.40@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789127383.898525:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b43170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+62:11712:x1876035733895936:12345-192.168.206.40@tcp:35:lhsmtool_posix.0 Request processed in 199us (358us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1789127383.898534:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 49 00000100:00100000:2.0:1789127383.900534:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127383.900728:0:12098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733896192 00000100:00100000:3.0:1789127383.900735:0:12098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733896192 00000100:00100000:3.0:1789127383.900897:0:12098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 180 00000100:00100000:3.0:1789127383.900908:0:12098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bfc492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+62:11712:x1876035733896192:12345-192.168.206.40@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789127383.900994:0:12098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bfc492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+62:11712:x1876035733896192:12345-192.168.206.40@tcp:57:lhsmtool_posix.0 Request processed in 88us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127383.901001:0:12098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 180 00000100:00100000:3.0:1789127383.902981:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127383.903038:0:10285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733896320 00000100:00100000:2.0:1789127383.903045:0:10285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733896320 00000100:00100000:2.0:1789127383.903085:0:10285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 181 00000100:00100000:2.0:1789127383.903094:0:10285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae97ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+62:11712:x1876035733896320:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789127383.903109:0:10285:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127383.903128:0:10285:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7c00/0xeeacf7c024301066 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7d81 expref: -99 pid: 10285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127383.903185:0:10285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6200/0xeeacf7c02430106d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127383.903199:0:10285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6200/0xeeacf7c02430106d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127383.903209:0:10285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6200/0xeeacf7c02430106d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789127383.903238:0:10285:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789127383.903253:0:10285:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6200/0xeeacf7c02430106d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127383.903275:0:10285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7c00/0xeeacf7c024301066 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d81 expref: 64 pid: 10285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127383.903300:0:10285:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6200/0xeeacf7c02430106d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d81 expref: 63 pid: 10285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127383.903308:0:10285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8df79f06c600) 00010000:00010000:2.0:1789127383.903311:0:10285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789127383.903314:0:10285:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7aeab6200, rc 0) 00000100:00100000:2.0:1789127383.903574:0:10285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae97ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+63:11712:x1876035733896320:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 Request processed in 480us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127383.903581:0:10285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 181 00000100:00100000:3.0:1789127383.905448:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127383.905493:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733896448 00000100:00100000:0.0:1789127383.905500:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733896448 00000100:00100000:0.0:1789127383.905533:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 51 00000100:00100000:0.0:1789127383.905540:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae978f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+7:2348:x1876035733896448:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789127383.905553:0:6689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127383.905569:0:6689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006e724354/0xeeacf7c024301074 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7d88 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789127383.905599:0:6689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa3ead6, blocks: 0x1 00010000:00010000:0.0:1789127383.905614:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=330s v=(0 0) 00010000:00010000:0.0:1789127383.905624:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789127383.905632:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e724354/0xeeacf7c024301074 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d88 expref: 8 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.905673:0:6689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006e724354/0xeeacf7c024301074 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d88 expref: 8 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.905685:0:6689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7ae728000, rc 0) 00000100:00100000:0.0:1789127383.905724:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae978f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+8:2348:x1876035733896448:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 Request processed in 184us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127383.905730:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 51 00000100:00100000:0.0:1789127383.911737:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127383.911849:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733896704 00000100:00100000:1.0:1789127383.911858:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733896704 00000100:00100000:1.0:1789127383.911984:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 182 00000100:00100000:1.0:1789127383.911994:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df682e70780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+63:11712:x1876035733896704:12345-192.168.206.40@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789127383.912084:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df682e70780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+63:11712:x1876035733896704:12345-192.168.206.40@tcp:57:lhsmtool_posix.0 Request processed in 91us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127383.912092:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 182 00000100:00100000:3.0:1789127383.915029:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127383.915127:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733896832 00000100:00100000:0.0:1789127383.915135:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733896832 00000100:00100000:0.0:1789127383.915187:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 52 00000100:00100000:0.0:1789127383.915197:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae97b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+8:11712:x1876035733896832:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789127383.915215:0:6686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127383.915233:0:6686:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c40e0629/0xeeacf7c02430107b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7d8f expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.915262:0:6686:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006e724354/0xeeacf7c024301074 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d88 expref: 9 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.915272:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789127383.915276:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789127383.915282:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c40e0629/0xeeacf7c02430107b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d8f expref: 9 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.915315:0:6686:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006e724354/0xeeacf7c024301074 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d88 expref: 9 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.915337:0:6686:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006e724354/0xeeacf7c024301074 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d88 expref: 9 pid: 6689 timeout: 430 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127383.915350:0:6686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae2f9e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6686:1876035752769024:192.168.206.40@tcp:104: 00000100:00100000:0.0:1789127383.915428:0:6686:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7aeaaf6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789127383.917917:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127383.917940:0:6686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae2f9e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6686:1876035752769024:192.168.206.40@tcp:104: 00010000:00010000:0.0:1789127383.917971:0:6686:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c40e0629/0xeeacf7c02430107b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d8f expref: 9 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.917991:0:6686:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7ae728a00, rc 0) 00000100:00100000:3.0:1789127383.917992:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733896960 00000100:00100000:3.0:1789127383.917998:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733896960 00010000:00010000:3.0:1789127383.918033:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006e724354/0xeeacf7c024301074 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d88 expref: 10 pid: 6689 timeout: 430 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127383.918089:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 75 00000100:00100000:3.0:1789127383.918099:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b4315e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+10:2348:x1876035733896960:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789127383.918111:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127383.918129:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006e724354/0xeeacf7c024301074 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d88 expref: 10 pid: 6689 timeout: 430 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127383.918142:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006e724354/0xeeacf7c024301074 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d88 expref: 10 pid: 6689 timeout: 430 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127383.918162:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006e724354/0xeeacf7c024301074 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d88 expref: 10 pid: 6689 timeout: 430 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127383.918174:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127383.918179:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127383.918186:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c40e0629/0xeeacf7c02430107b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d8f expref: 9 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127383.918196:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c40e0629/0xeeacf7c02430107b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d8f expref: 9 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127383.918225:0:5817:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c40e0629/0xeeacf7c02430107b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d8f expref: 9 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127383.918236:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a2c5e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5817:1876035752769152:192.168.206.40@tcp:105: 00000100:00100000:0.0:1789127383.918292:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae97b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+9:11712:x1876035733896832:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 Request processed in 3096us (3270us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127383.918300:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 52 00000100:00100000:3.0:1789127383.918301:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7b46be480 going to sleep for 11 seconds 00000100:00100000:0.0:1789127383.921422:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127383.921556:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733897088 00000100:00100000:1.0:1789127383.921564:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733897088 00002000:00100000:1.0:1789127383.921612:0:6693:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8df7ae2f9e00 x1876035733897088/t0(0) o4->28762f98-a240-4662-a754-e28bbeb6cb4b@192.168.206.40@tcp:119/0 lens 504/0 e 0 to 0 dl 1789127394 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789127383.921930:0:6693:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff8df7ae2f9e00 with x1876035733897088 ext(0->8) 00002000:00010000:1.0:1789127383.921936:0:6693:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df7ae2f9e00 00000100:00100000:1.0:1789127383.921986:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 4 00000100:00100000:1.0:1789127383.921995:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae2f9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+9:2349:x1876035733897088:12345-192.168.206.40@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789127383.922389:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae2f9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+11:2349:x1876035733897088:12345-192.168.206.40@tcp:4:lhsmtool_posix.0 Request processed in 394us (974us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1789127383.922398:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 4 00002000:00100000:1.0:1789127383.922405:0:6693:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8df7ae2f9e00 x1876035733897088/t4294967314(0) o4->28762f98-a240-4662-a754-e28bbeb6cb4b@192.168.206.40@tcp:119/0 lens 504/448 e 0 to 0 dl 1789127394 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789127383.922414:0:6693:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff8df7ae2f9e00 with x1876035733897088 ext(0->8) 00002000:00010000:1.0:1789127383.922417:0:6693:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df7ae2f9e00 00000100:00100000:3.0:1789127383.922565:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a2c5e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5817:1876035752769152:192.168.206.40@tcp:105: 00010000:00010000:3.0:1789127383.922585:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127383.922620:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b4315e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+10:2348:x1876035733896960:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 4517us (4705us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127383.922628:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 75 00000100:00100000:1.0:1789127383.924988:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127383.925194:0:12098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733897216 00000100:00100000:3.0:1789127383.925205:0:12098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733897216 00000100:00100000:3.0:1789127383.925284:0:12098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 183 00000100:00100000:3.0:1789127383.925294:0:12098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae059a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+63:11712:x1876035733897216:12345-192.168.206.40@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1789127383.950812:0:12098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae059a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+63:11712:x1876035733897216:12345-192.168.206.40@tcp:44:lhsmtool_posix.0 Request processed in 25496us (25807us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127383.950825:0:12098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 183 00000001:00080000:2.0:1789127383.954111:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967456 is committed 00000004:00080000:2.0:1789127383.954131:0:5852:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000001:00080000:2.0:1789127383.954160:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000001:00080000:2.0:1789127383.954179:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967461 is committed 00000004:00080000:2.0:1789127383.954185:0:5852:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000020:00080000:2.0:1789127383.954230:0:5852:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8df7b46be3c0 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1789127383.954235:0:5852:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8df7aea5d300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8df7b46bea80 00000020:00080000:2.0:1789127383.954238:0:5852:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8df7aea5d800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8df7bbd82000 00000100:00100000:3.0:1789127383.954420:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789127383.954437:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a2c5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1876035752769280:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789127383.954494:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127383.954535:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752769280 00000100:00100000:3.0:1789127383.954541:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752769280 00000020:00080000:0.0:1789127383.954735:0:5863:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:0.0:1789127383.954927:0:5863:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:1.0:1789127383.955105:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae058780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752769408:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789127383.955140:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127383.955285:0:8063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752769408 00000100:00100000:0.0:1789127383.955290:0:8063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752769408 00000100:00100000:0.0:1789127383.955320:0:8063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789127383.955329:0:8063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae95b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1876035752769280:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1789127383.955456:0:8063:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1789127383.955460:0:8063:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1789127383 00002000:00010000:0.0:1789127383.955462:0:8063:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789127383.955464:0:8063:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1789127382 -> 1789127383 00002000:00010000:0.0:1789127383.955564:0:8063:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1789127383.955605:0:8063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae95b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3300:x1876035752769280:12345-0@lo:2:osp-syn-1-0.0 Request processed in 277us (1111us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1789127383.955612:0:8063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789127383.955629:0:8063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789127383.955635:0:8063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bb96d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3302:x1876035752769408:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1789127383.955660:0:8063:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:0.0:1789127383.955683:0:8063:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aa3ead4, atime: 0x6aa3ead5, ctime: 0x6aa3ead4, blocks: 0x1 00010000:00010000:0.0:1789127383.955690:0:8063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b5fb4f9/0xeeacf7c024301082 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.955705:0:8063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=330s v=(0 0) 00010000:00010000:0.0:1789127383.955709:0:8063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789127383.955715:0:8063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b5fb4f9/0xeeacf7c024301082 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.955730:0:8063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b5fb4f9/0xeeacf7c024301082 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.955739:0:8063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b5fb4f9/0xeeacf7c024301082 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.955748:0:8063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b5fb4f9/0xeeacf7c024301082 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.955765:0:8063:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:3.0:1789127383.955933:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1789127383.955968:0:3300:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8df79a2c5e00/2, rc 0, transno 4294967315 00000100:00100000:3.0:1789127383.955974:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a2c5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1876035752769280:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1789127383.956234:0:8063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bb96d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3302:x1876035752769408:12345-0@lo:6:osp-syn-0-0.0 Request processed in 597us (1091us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1789127383.956247:0:8063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00010000:0.0:1789127383.956265:0:8511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789127383.956271:0:8511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b5fb4f9/0xeeacf7c024301082 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.956279:0:8511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7ae728c00 already unused, calling callback (ffffffffc17a4550) 00010000:00010000:0.0:1789127383.956283:0:8511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b5fb4f9/0xeeacf7c024301082 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.956292:0:8511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b5fb4f9/0xeeacf7c024301082 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.956308:0:8511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b5fb4f9/0xeeacf7c024301082 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.956315:0:8511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b5fb4f9/0xeeacf7c024301082 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127383.956330:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127383.956332:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127383.956333:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789127383.956779:0:3302:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8df7ae058780/2, rc 0, transno 4294967307 00000100:00100000:3.0:1789127383.956786:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae058780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752769408:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789127383.959236:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127383.959677:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733897344 00000100:00100000:3.0:1789127383.959686:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733897344 00000100:00100000:3.0:1789127383.959746:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 55 00000100:00100000:3.0:1789127383.959757:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bb96d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+10:2347:x1876035733897344:12345-192.168.206.40@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1789127384.034417:0:7646:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000001:00080000:0.0:1789127384.034700:0:7646:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000100:00100000:3.0:1789127384.035076:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bb96d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+8:2347:x1876035733897344:12345-192.168.206.40@tcp:16:lhsmtool_posix.0 Request processed in 75315us (75842us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127384.035102:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 55 00000100:00100000:3.0:1789127384.037217:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127384.037292:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733897600 00000100:00100000:0.0:1789127384.037302:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733897600 00000100:00100000:0.0:1789127384.037756:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 184 00000100:00100000:0.0:1789127384.037768:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae95a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+18:11712:x1876035733897600:12345-192.168.206.40@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789127384.037860:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789127384.037886:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6200/0xeeacf7c02430106d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d81 expref: 18 pid: 10285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127384.038039:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8df79f06c600) 00010000:00010000:0.0:1789127384.038044:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789127384.038074:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729800/0xeeacf7c024301089 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127384.038087:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729800/0xeeacf7c024301089 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127384.038097:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729800/0xeeacf7c024301089 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789127384.038328:0:5830:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000004cae2334 reply state 000000002db73c45 transno 4294967462 ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729800/0xeeacf7c024301089 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127384.038336:0:5830:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789127384.038439:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae95a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+19:11712:x1876035733897600:12345-192.168.206.40@tcp:36:lhsmtool_posix.0 Request processed in 673us (1229us total) trans 4294967462 rc 0/0 00000100:00100000:0.0:1789127384.038447:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 184 00010000:00010000:2.0:1789127384.041109:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729800/0xeeacf7c024301089 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127384.041127:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729800/0xeeacf7c024301089 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127384.041136:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729800/0xeeacf7c024301089 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127384.041142:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7ae729800 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:2.0:1789127384.041162:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729800/0xeeacf7c024301089 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127384.041170:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729800/0xeeacf7c024301089 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127384.041187:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8df79f06c600) 00010000:00010000:2.0:1789127384.041190:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789127384.041196:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729800/0xeeacf7c024301089 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127384.041203:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729800/0xeeacf7c024301089 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127384.052923:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127384.053067:0:8063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733897728 00000100:00100000:0.0:1789127384.053077:0:8063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733897728 00000100:00100000:0.0:1789127384.053127:0:8063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 56 00000100:00100000:0.0:1789127384.053137:0:8063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae9583c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+7:2347:x1876035733897728:12345-192.168.206.40@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789127384.053367:0:8063:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1789127384.053371:0:8063:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1789127383 -> 1789127382 00002000:00010000:0.0:1789127384.053373:0:8063:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1789127381 00002000:00010000:0.0:1789127384.053384:0:8063:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1789127383 -> 1789127382 00002000:00010000:0.0:1789127384.053387:0:8063:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1789127384.053449:0:8063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae9583c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+8:2347:x1876035733897728:12345-192.168.206.40@tcp:2:lhsmtool_posix.0 Request processed in 313us (535us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1789127384.053457:0:8063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 56 00000100:00100000:3.0:1789127384.060331:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127384.060404:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733897984 00000100:00100000:0.0:1789127384.060413:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733897984 00000100:00100000:0.0:1789127384.060471:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 185 00000100:00100000:0.0:1789127384.060489:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae959680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+18:11712:x1876035733897984:12345-192.168.206.40@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1789127384.060553:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729400/0xeeacf7c024301090 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127384.060569:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024301051 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d73 expref: 18 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127384.060577:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729400/0xeeacf7c024301090 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127384.060610:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024301051 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d73 expref: 18 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127384.060635:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024301051 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d73 expref: 18 pid: 12098 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127384.060658:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae2fad00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5831:1876035752769536:192.168.206.40@tcp:104: 00000100:00100000:0.0:1789127384.060735:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7aeaaf180 going to sleep for 11 seconds 00000100:00100000:2.0:1789127384.062828:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae2fad00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5831:1876035752769536:192.168.206.40@tcp:104: 00010000:00010000:2.0:1789127384.062853:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729400/0xeeacf7c024301090 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127384.063510:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127384.068259:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733898112 00000100:00100000:1.0:1789127384.068273:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733898112 00010000:00010000:1.0:1789127384.068313:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024301051 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d73 expref: 19 pid: 12098 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127384.068345:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 76 00000100:00100000:1.0:1789127384.068360:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7889cb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+19:2349:x1876035733898112:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789127384.068375:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789127384.068382:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024301051 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d73 expref: 19 pid: 12098 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127384.068394:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024301051 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d73 expref: 19 pid: 12098 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127384.068415:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024301051 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d73 expref: 19 pid: 12098 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127384.068430:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8df79f06c600) 00010000:00010000:1.0:1789127384.068435:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729400/0xeeacf7c024301090 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127384.068444:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729400/0xeeacf7c024301090 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127384.068451:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729400/0xeeacf7c024301090 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127384.070447:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789127384.070529:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7889cb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+18:2349:x1876035733898112:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 2166us (7016us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127384.070541:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 76 00010000:00010000:3.0:1789127384.070877:0:5831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729400/0xeeacf7c024301090 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.070887:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729400/0xeeacf7c024301090 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.070914:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729400/0xeeacf7c024301090 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.070921:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729400/0xeeacf7c024301090 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.070927:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729400/0xeeacf7c024301090 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.070933:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7ae729400 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:3.0:1789127384.070937:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729400/0xeeacf7c024301090 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.070945:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729400/0xeeacf7c024301090 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.070958:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8df79f06c600) 00010000:00010000:3.0:1789127384.070961:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789127384.070965:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729400/0xeeacf7c024301090 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.070982:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729400/0xeeacf7c024301090 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127384.071128:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae959680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+17:11712:x1876035733897984:12345-192.168.206.40@tcp:55:lhsmtool_posix.0 Request processed in 10638us (10803us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789127384.071362:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 185 00000100:00100000:1.0:1789127384.080668:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127384.080839:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733898240 00000100:00100000:2.0:1789127384.080847:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733898240 00000100:00100000:2.0:1789127384.080908:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 57 00000100:00100000:2.0:1789127384.080918:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bb96cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+8:2346:x1876035733898240:12345-192.168.206.40@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789127384.080957:0:6688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b6a5793a/0xeeacf7c024301097 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127384.080977:0:6688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c40e0629/0xeeacf7c02430107b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d8f expref: 8 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127384.080987:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127384.080999:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789127384.081005:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b6a5793a/0xeeacf7c024301097 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127384.081038:0:6688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c40e0629/0xeeacf7c02430107b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d8f expref: 8 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127384.081053:0:6688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c40e0629/0xeeacf7c02430107b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d8f expref: 8 pid: 6686 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127384.081067:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7bfc49680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6688:1876035752769664:192.168.206.40@tcp:104: 00000100:00100000:2.0:1789127384.081148:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df791c47d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789127384.086682:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7bfc49680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6688:1876035752769664:192.168.206.40@tcp:104: 00010000:00010000:2.0:1789127384.086710:0:6688:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b6a5793a/0xeeacf7c024301097 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127384.089908:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127384.090663:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733898368 00000100:00100000:3.0:1789127384.090674:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733898368 00010000:00010000:3.0:1789127384.090715:0:8454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c40e0629/0xeeacf7c02430107b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d8f expref: 9 pid: 6686 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127384.090763:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 77 00000100:00100000:3.0:1789127384.090773:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bb96e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+9:2348:x1876035733898368:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789127384.090809:0:8454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127384.090829:0:8454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c40e0629/0xeeacf7c02430107b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d8f expref: 9 pid: 6686 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.090843:0:8454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c40e0629/0xeeacf7c02430107b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d8f expref: 9 pid: 6686 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.090865:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c40e0629/0xeeacf7c02430107b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d8f expref: 9 pid: 6686 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.090880:0:8454:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789127384.090885:0:8454:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789127384.090891:0:8454:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b6a5793a/0xeeacf7c024301097 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.090908:0:8454:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b6a5793a/0xeeacf7c024301097 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.090935:0:8454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127384.090984:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bb96e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+8:2348:x1876035733898368:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 212us (1086us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127384.090992:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 77 00010000:00010000:1.0:1789127384.091177:0:6688:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b6a5793a/0xeeacf7c024301097 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127384.091200:0:6688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b6a5793a/0xeeacf7c024301097 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127384.091224:0:6688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b6a5793a/0xeeacf7c024301097 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127384.091233:0:6688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b6a5793a/0xeeacf7c024301097 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127384.091240:0:6688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b6a5793a/0xeeacf7c024301097 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127384.091247:0:6688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7aeab6e00 already unused, calling callback (ffffffffc17a4550) 00010000:00010000:1.0:1789127384.091251:0:6688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6a5793a/0xeeacf7c024301097 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127384.091260:0:6688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6a5793a/0xeeacf7c024301097 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127384.091272:0:6688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b6a5793a/0xeeacf7c024301097 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127384.091279:0:6688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b6a5793a/0xeeacf7c024301097 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127384.091349:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bb96cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+7:2346:x1876035733898240:12345-192.168.206.40@tcp:1:lhsmtool_posix.0 Request processed in 10432us (10689us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127384.091358:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 57 00000100:00100000:1.0:1789127384.094980:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127384.095083:0:12098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733898624 00000100:00100000:2.0:1789127384.095092:0:12098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733898624 00000100:00100000:2.0:1789127384.095171:0:12098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 186 00000100:00100000:2.0:1789127384.095182:0:12098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae97b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+17:11712:x1876035733898624:12345-192.168.206.40@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789127384.095256:0:12098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7400/0xeeacf7c02430109e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127384.095275:0:12098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7400/0xeeacf7c02430109e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127384.095288:0:12098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7400/0xeeacf7c02430109e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127384.095488:0:12098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7600/0xeeacf7c0243010a5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127384.095499:0:12098:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c02430105f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d7a expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127384.095507:0:12098:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7600/0xeeacf7c0243010a5 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127384.095537:0:12098:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c02430105f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d7a expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127384.095551:0:12098:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c02430105f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d7a expref: 18 pid: 5830 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127384.095564:0:12098:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7bfc49680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12098:1876035752769792:192.168.206.40@tcp:104: 00000100:00100000:2.0:1789127384.095814:0:12098:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df791c47d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789127384.104260:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127384.104361:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733898752 00000100:00100000:1.0:1789127384.104375:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733898752 00010000:00010000:1.0:1789127384.104411:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c02430105f lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d7a expref: 19 pid: 5830 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127384.104489:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 78 00000100:00100000:1.0:1789127384.104499:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae2f8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+19:2348:x1876035733898752:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789127384.104512:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789127384.104519:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c02430105f lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d7a expref: 19 pid: 5830 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127384.104532:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c02430105f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d7a expref: 19 pid: 5830 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127384.104552:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8df79f06c600) 00010000:00010000:1.0:1789127384.104557:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7600/0xeeacf7c0243010a5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127384.104566:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7600/0xeeacf7c0243010a5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127384.104574:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7600/0xeeacf7c0243010a5 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127384.104608:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789127384.104736:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae2f8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+19:2348:x1876035733898752:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 238us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127384.104744:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 78 00010000:00010000:2.0:1789127384.104869:0:12098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c02430105f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d7a expref: 18 pid: 5830 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127384.104883:0:12098:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7bfc49680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12098:1876035752769792:192.168.206.40@tcp:104: 00010000:00010000:2.0:1789127384.104902:0:12098:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7600/0xeeacf7c0243010a5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127384.104911:0:12098:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7600/0xeeacf7c0243010a5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127384.104917:0:12098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7600/0xeeacf7c0243010a5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789127384.105081:0:12098:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:2.0:1789127384.105206:0:12098:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:2.0:1789127384.105243:0:12098:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:2.0:1789127384.105325:0:12098:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7bfc49680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12098:1876035752769920:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1789127384.105371:0:12098:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127384.105401:0:12098:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df791c47b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789127384.105444:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752769920 00000100:00100000:0.0:1789127384.105453:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752769920 00000100:00100000:0.0:1789127384.105486:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789127384.105493:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bfc49e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:12098:x1876035752769920:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1789127384.105622:0:12098:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:2.0:1789127384.105627:0:12098:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8df79a2c5e00, transno 4294967315 00000100:00100000:2.0:1789127384.105639:0:12098:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7bfc49680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12098:1876035752769920:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1789127384.105743:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bfc49e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:12098:x1876035752769920:12345-0@lo:1000:mdt00_004.0 Request processed in 248us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127384.105749:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000001:00080000:2.0:1789127384.106373:0:12098:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:2.0:1789127384.106424:0:12098:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7bfc49680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12098:1876035752770048:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1789127384.106453:0:12098:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127384.106477:0:12098:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df791c47d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789127384.106853:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752770048 00000100:00100000:0.0:1789127384.106859:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752770048 00000100:00100000:0.0:1789127384.106895:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789127384.106903:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bfc4a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:12098:x1876035752770048:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1789127384.107074:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bfc4a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:12098:x1876035752770048:12345-0@lo:1000:mdt00_004.0 Request processed in 171us (619us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1789127384.107081:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789127384.107118:0:12098:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7bfc49680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12098:1876035752770048:0@lo:1000:mdt00_004.0 00010000:00010000:0.0:1789127384.107145:0:12098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7600/0xeeacf7c0243010a5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127384.107155:0:12098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7600/0xeeacf7c0243010a5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127384.107161:0:12098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7600/0xeeacf7c0243010a5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127384.107166:0:12098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7aeab7600 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:0.0:1789127384.107170:0:12098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7600/0xeeacf7c0243010a5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127384.107177:0:12098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7600/0xeeacf7c0243010a5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127384.107203:0:12098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8df79f06c600) 00010000:00010000:0.0:1789127384.107206:0:12098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789127384.107210:0:12098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7600/0xeeacf7c0243010a5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127384.107216:0:12098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7600/0xeeacf7c0243010a5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127384.107242:0:12098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c024300fda lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127384.107248:0:12098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c024300fda lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127384.107253:0:12098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c024300fda lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127384.107258:0:12098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7ae729e00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:0.0:1789127384.107261:0:12098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c024300fda lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127384.107267:0:12098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c024300fda lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127384.107274:0:12098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df782a68700) 00010000:00010000:0.0:1789127384.107276:0:12098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789127384.107279:0:12098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c024300fda lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127384.107285:0:12098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c024300fda lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127384.107318:0:12098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729400/0xeeacf7c0243010ac lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127384.107331:0:12098:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729000/0xeeacf7c024300ff6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d5e expref: 21 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127384.107339:0:12098:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729400/0xeeacf7c0243010ac lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127384.107364:0:12098:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729000/0xeeacf7c024300ff6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d5e expref: 21 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127384.107378:0:12098:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729000/0xeeacf7c024300ff6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d5e expref: 21 pid: 12098 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127384.107388:0:12098:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae2f8f00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12098:1876035752770176:192.168.206.40@tcp:104: 00000100:00100000:0.0:1789127384.107445:0:12098:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7aeaaf6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789127384.111611:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127384.111659:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733898880 00000100:00100000:0.0:1789127384.111667:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733898880 00010000:00010000:0.0:1789127384.111704:0:8454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729000/0xeeacf7c024300ff6 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d5e expref: 22 pid: 12098 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127384.111736:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 79 00000100:00100000:0.0:1789127384.111746:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae2f9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+22:2349:x1876035733898880:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789127384.111761:0:8454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789127384.111769:0:8454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729000/0xeeacf7c024300ff6 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d5e expref: 22 pid: 12098 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127384.111812:0:8454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729000/0xeeacf7c024300ff6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d5e expref: 22 pid: 12098 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127384.111839:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df782a68700) 00010000:00010000:0.0:1789127384.111844:0:8454:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729400/0xeeacf7c0243010ac lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127384.111854:0:8454:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729400/0xeeacf7c0243010ac lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127384.111861:0:8454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729400/0xeeacf7c0243010ac lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127384.111880:0:8454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789127384.111926:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae2f9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+22:2349:x1876035733898880:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 181us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127384.111934:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 79 00010000:00010000:2.0:1789127384.112494:0:12098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729000/0xeeacf7c024300ff6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d5e expref: 21 pid: 12098 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127384.112510:0:12098:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae2f8f00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12098:1876035752770176:192.168.206.40@tcp:104: 00010000:00010000:2.0:1789127384.112527:0:12098:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729400/0xeeacf7c0243010ac lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127384.112536:0:12098:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729400/0xeeacf7c0243010ac lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127384.112542:0:12098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729400/0xeeacf7c0243010ac lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127384.112554:0:12098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729400/0xeeacf7c0243010ac lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127384.112568:0:12098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729400/0xeeacf7c0243010ac lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127384.112575:0:12098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729400/0xeeacf7c0243010ac lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127384.112580:0:12098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7ae729400 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:2.0:1789127384.112585:0:12098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729400/0xeeacf7c0243010ac lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127384.112604:0:12098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729400/0xeeacf7c0243010ac lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127384.112621:0:12098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df782a68700) 00010000:00010000:2.0:1789127384.112624:0:12098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789127384.112628:0:12098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729400/0xeeacf7c0243010ac lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127384.112635:0:12098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729400/0xeeacf7c0243010ac lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127384.112654:0:12098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7400/0xeeacf7c02430109e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127384.112661:0:12098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7400/0xeeacf7c02430109e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127384.112667:0:12098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7400/0xeeacf7c02430109e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127384.112672:0:12098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7aeab7400 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:2.0:1789127384.112681:0:12098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7400/0xeeacf7c02430109e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127384.112688:0:12098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7400/0xeeacf7c02430109e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127384.112696:0:12098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df782a68700) 00010000:00010000:2.0:1789127384.112699:0:12098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789127384.112701:0:12098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7400/0xeeacf7c02430109e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127384.112707:0:12098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7400/0xeeacf7c02430109e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127384.112916:0:12098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae97b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+20:11712:x1876035733898624:12345-192.168.206.40@tcp:57:lhsmtool_posix.0 Request processed in 17734us (17947us total) trans 4294967467 rc 0/0 00000100:00100000:2.0:1789127384.112925:0:12098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 186 00000020:00080000:2.0:1789127384.112929:0:12098:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1789127384.113029:0:12084:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789127384.113033:0:12084:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789127384.113554:0:12084:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1789127384.113561:0:12084:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789127384.118369:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127384.118430:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733899136 00000100:00100000:3.0:1789127384.118439:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733899136 00000100:00100000:3.0:1789127384.118517:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 50 00000100:00100000:3.0:1789127384.118527:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79156ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+20:11712:x1876035733899136:12345-192.168.206.40@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789127384.119182:0:5833:0:(mdd_object.c:4024:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789127384.119282:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967468 00010000:00010000:3.0:1789127384.119327:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c0243010b3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.119343:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c0243010b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.119354:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c0243010b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.119361:0:5833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c0243010b3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.119366:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c0243010b3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.119381:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c0243010b3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.119407:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789127384.119488:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79156ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+22:11712:x1876035733899136:12345-192.168.206.40@tcp:35:lhsmtool_posix.0 Request processed in 959us (1123us total) trans 4294967469 rc 0/0 00000100:00100000:3.0:1789127384.119496:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 50 00000020:00080000:3.0:1789127384.119501:0:5833:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789127384.119572:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789127384.119579:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c0243010b3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127384.119586:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df798df1e00 already unused, calling callback (ffffffffc17a4550) 00010000:00010000:0.0:1789127384.119590:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c0243010b3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127384.119597:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c0243010b3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127384.119610:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8df79f06c800) 00010000:00010000:0.0:1789127384.119618:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789127384.119623:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c0243010b3 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127384.119629:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c0243010b3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127384.119655:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127384.119657:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127384.119659:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789127384.442018:0:12911:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789127384.442027:0:12911:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789127384.442072:0:12911:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:0.0:1789127384.442077:0:12911:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1789127384.506210:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127384.563155:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79062e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1876035752770688:0@lo:400:kworker.0 00000100:00100000:2.0:1789127384.563155:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a3a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3303:1876035752770304:0@lo:400:kworker.0 00000100:00100000:2.0:1789127384.563236:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127384.563237:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127384.563314:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7aeaba940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876035752770432:0@lo:400:kworker.0 00000100:00100000:2.0:1789127384.563320:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7aeab8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1876035752770560:0@lo:400:kworker.0 00000100:00100000:2.0:1789127384.563353:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127384.563392:0:10285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752770688 00000100:00100000:2.0:1789127384.563399:0:10285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752770688 00000100:00100000:2.0:1789127384.563452:0:10285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752770560 00000100:00100000:2.0:1789127384.563455:0:10285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752770560 00000100:00100000:2.0:1789127384.563483:0:10285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789127384.563492:0:10285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae95ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876035752770688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127384.563544:0:10285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae95ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876035752770688:12345-0@lo:400:kworker.0 Request processed in 53us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127384.563552:0:10285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789127384.563570:0:10285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789127384.563577:0:10285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79a2c5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876035752770560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127384.563612:0:10285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79a2c5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876035752770560:12345-0@lo:400:kworker.0 Request processed in 35us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127384.563618:0:10285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00080000:2.0:1789127384.563637:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789127384.563661:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127384.563690:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79062e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1876035752770688:0@lo:400:kworker.0 00000100:00100000:2.0:1789127384.563717:0:12098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752770432 00000100:00100000:2.0:1789127384.563722:0:12098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752770432 00000100:00100000:1.0:1789127384.563722:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752770304 00000100:00100000:1.0:1789127384.563730:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752770304 00000100:00100000:2.0:1789127384.563751:0:12098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789127384.563759:0:12098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae95a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876035752770432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127384.563773:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1789127384.564489:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df787bbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:3303:x1876035752770304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127384.564547:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df787bbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:3303:x1876035752770304:12345-0@lo:400:kworker.0 Request processed in 765us (1313us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127384.564554:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1789127384.564950:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a3a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3303:1876035752770304:0@lo:400:kworker.0 00000100:00100000:3.0:1789127384.565962:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7aeab8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1876035752770560:0@lo:400:kworker.0 00000100:00100000:0.0:1789127384.566972:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127384.567092:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733899392 00000100:00100000:3.0:1789127384.567099:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733899392 00000100:00100000:3.0:1789127384.567151:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 187 00000100:00100000:3.0:1789127384.567160:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae2f8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+22:11722:x1876035733899392:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:3.0:1789127384.567182:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127384.567201:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c0243010ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7d96 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.567457:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c0243010c1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.567483:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c0243010c1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.567495:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c0243010c1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789127384.567508:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:3.0:1789127384.567875:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c0243010ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d96 expref: 25 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.567893:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c0243010c1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d96 expref: 24 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.567900:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8df79f06cd00) 00010000:00010000:3.0:1789127384.567903:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789127384.567906:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df798df1e00, rc 0) 00000100:00100000:3.0:1789127384.567961:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae2f8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+24:11722:x1876035733899392:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 801us (994us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1789127384.567968:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 187 00000100:00100000:3.0:1789127384.568047:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae958f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1876035752770816:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789127384.568063:0:12098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae95a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876035752770432:12345-0@lo:400:kworker.0 Request processed in 4302us (4401us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127384.568073:0:12098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789127384.568091:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127384.568615:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7aeaba940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876035752770432:0@lo:400:kworker.0 00000100:00100000:2.0:1789127384.568666:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752770816 00000100:00100000:2.0:1789127384.568671:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752770816 00000100:00100000:2.0:1789127384.568712:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789127384.568722:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae9592c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1876035752770816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789127384.568749:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:2.0:1789127384.568822:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae9592c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1876035752770816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (732us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127384.568828:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789127384.571312:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae958f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1876035752770816:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789127384.573823:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127384.573968:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733899520 00000100:00100000:3.0:1789127384.573978:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733899520 00000100:00100000:3.0:1789127384.574086:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 188 00000100:00100000:3.0:1789127384.574097:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae2fad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+24:11722:x1876035733899520:12345-192.168.206.40@tcp:34:lfs.0 00010000:00010000:3.0:1789127384.574175:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c0243010cf lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.574206:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c0243010cf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.574216:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c0243010cf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.574231:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c0243010d6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.574237:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c0243010d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.574243:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c0243010d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.574550:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173000/0xeeacf7c0243010dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.574563:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173000/0xeeacf7c0243010dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.574571:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173000/0xeeacf7c0243010dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789127384.574628:0:5830:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173000/0xeeacf7c0243010dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.574650:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c0243010cf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.574657:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c0243010cf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.574673:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c0243010cf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.574679:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df798df0200 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:3.0:1789127384.574683:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c0243010cf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.574691:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c0243010cf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.574702:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8df79f06cd00) 00010000:00010000:3.0:1789127384.574705:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127384.574709:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c0243010cf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.574723:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c0243010cf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.574741:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c0243010d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.574751:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c0243010d6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.574758:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c0243010d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.574763:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df798df1c00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:3.0:1789127384.574765:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c0243010d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.574780:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c0243010d6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.574809:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8df79f06c300) 00010000:00010000:3.0:1789127384.574812:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127384.574815:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c0243010d6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.574821:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c0243010d6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.574842:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173000/0xeeacf7c0243010dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.574851:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173000/0xeeacf7c0243010dd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.574857:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173000/0xeeacf7c0243010dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.574929:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7c2173000 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:3.0:1789127384.574933:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173000/0xeeacf7c0243010dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.574940:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173000/0xeeacf7c0243010dd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.574948:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df79f06cc00) 00010000:00010000:3.0:1789127384.574951:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127384.574953:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173000/0xeeacf7c0243010dd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.574969:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173000/0xeeacf7c0243010dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127384.575060:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae2fad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+24:11722:x1876035733899520:12345-192.168.206.40@tcp:34:lfs.0 Request processed in 963us (1276us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127384.581376:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 188 00000100:00100000:2.0:1789127384.638727:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127384.639014:0:12098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733899776 00000100:00100000:3.0:1789127384.639025:0:12098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733899776 00000100:00100000:3.0:1789127384.639087:0:12098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 189 00000100:00100000:3.0:1789127384.639099:0:12098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6811c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+24:11725:x1876035733899776:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:3.0:1789127384.639119:0:12098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127384.639140:0:12098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173000/0xeeacf7c0243010e4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7d9d expref: -99 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.639207:0:12098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2172c00/0xeeacf7c0243010eb lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.639222:0:12098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2172c00/0xeeacf7c0243010eb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.639234:0:12098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2172c00/0xeeacf7c0243010eb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.639248:0:12098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173e00/0xeeacf7c0243010f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.639255:0:12098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173e00/0xeeacf7c0243010f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.639274:0:12098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173e00/0xeeacf7c0243010f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.639573:0:12098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173600/0xeeacf7c0243010f9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.639655:0:12098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173600/0xeeacf7c0243010f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.639666:0:12098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173600/0xeeacf7c0243010f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789127384.639677:0:12098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1789127384.639765:0:12098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2172c00/0xeeacf7c0243010eb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.639772:0:12098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2172c00/0xeeacf7c0243010eb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.639779:0:12098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2172c00/0xeeacf7c0243010eb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.640132:0:12098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7c2172c00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:3.0:1789127384.640137:0:12098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2172c00/0xeeacf7c0243010eb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.640145:0:12098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2172c00/0xeeacf7c0243010eb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.640155:0:12098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8df79f06cd00) 00010000:00010000:3.0:1789127384.640158:0:12098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127384.640169:0:12098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2172c00/0xeeacf7c0243010eb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.640175:0:12098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2172c00/0xeeacf7c0243010eb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.640185:0:12098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173e00/0xeeacf7c0243010f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.640191:0:12098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173e00/0xeeacf7c0243010f2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.640196:0:12098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173e00/0xeeacf7c0243010f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.640200:0:12098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7c2173e00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:3.0:1789127384.640202:0:12098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173e00/0xeeacf7c0243010f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.640207:0:12098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173e00/0xeeacf7c0243010f2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.640213:0:12098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8df79f06cc00) 00010000:00010000:3.0:1789127384.640215:0:12098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127384.640217:0:12098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173e00/0xeeacf7c0243010f2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.640222:0:12098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173e00/0xeeacf7c0243010f2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.640259:0:12098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173000/0xeeacf7c0243010e4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d9d expref: 27 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.640280:0:12098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173600/0xeeacf7c0243010f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d9d expref: 26 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.640286:0:12098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df79f06c300) 00010000:00010000:3.0:1789127384.640289:0:12098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789127384.640291:0:12098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7c2173600, rc 0) 00000100:00100000:3.0:1789127384.640512:0:12098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6811c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+26:11725:x1876035733899776:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 1414us (1792us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1789127384.640520:0:12098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 189 00000100:00100000:1.0:1789127384.646340:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127384.646396:0:10285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733899904 00000100:00100000:3.0:1789127384.646405:0:10285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733899904 00000100:00100000:3.0:1789127384.646455:0:10285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 190 00000100:00100000:3.0:1789127384.646465:0:10285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79062c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+26:11725:x1876035733899904:12345-192.168.206.40@tcp:54:lfs.0 00010000:00010000:3.0:1789127384.646525:0:10285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173000/0xeeacf7c024301107 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.646540:0:10285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173000/0xeeacf7c024301107 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.646552:0:10285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173000/0xeeacf7c024301107 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.646574:0:10285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173000/0xeeacf7c024301107 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.646580:0:10285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173000/0xeeacf7c024301107 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.646598:0:10285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173000/0xeeacf7c024301107 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.646604:0:10285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7c2173000 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:3.0:1789127384.646608:0:10285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173000/0xeeacf7c024301107 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.646615:0:10285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173000/0xeeacf7c024301107 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.646627:0:10285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df79f06c300) 00010000:00010000:3.0:1789127384.646630:0:10285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789127384.646634:0:10285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173000/0xeeacf7c024301107 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.646648:0:10285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173000/0xeeacf7c024301107 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127384.646711:0:10285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79062c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+26:11725:x1876035733899904:12345-192.168.206.40@tcp:54:lfs.0 Request processed in 248us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127384.646719:0:10285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 190 00000100:00100000:1.0:1789127384.649558:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127384.649747:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733900160 00000100:00100000:2.0:1789127384.649757:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733900160 00000100:00100000:2.0:1789127384.649937:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 51 00000100:00100000:2.0:1789127384.649947:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79062e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+26:11725:x1876035733900160:12345-192.168.206.40@tcp:35:lfs.0 00000100:00100000:2.0:1789127384.650170:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79062e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+27:11725:x1876035733900160:12345-192.168.206.40@tcp:35:lfs.0 Request processed in 223us (618us total) trans 4294967472 rc 0/0 00000100:00100000:2.0:1789127384.650179:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 51 00000100:00100000:2.0:1789127384.688537:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127384.688621:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733900416 00000100:00100000:3.0:1789127384.688630:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733900416 00000100:00100000:3.0:1789127384.688700:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 191 00000100:00100000:3.0:1789127384.688710:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6811c6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+27:11260:x1876035733900416:12345-192.168.206.40@tcp:101:bash.0 00010000:00010000:3.0:1789127384.688733:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127384.688754:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173000/0xeeacf7c02430110e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7da4 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.688899:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173e00/0xeeacf7c024301115 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.688914:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173600/0xeeacf7c0243010f9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d9d expref: 28 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.688924:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173e00/0xeeacf7c024301115 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.688961:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173600/0xeeacf7c0243010f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d9d expref: 28 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.688975:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173600/0xeeacf7c0243010f9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d9d expref: 28 pid: 12098 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127384.688989:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae958f00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5830:1876035752770944:192.168.206.40@tcp:104: 00000100:00100000:3.0:1789127384.689089:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7a037c240 going to sleep for 11 seconds 00000100:00100000:1.0:1789127384.691281:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127384.691350:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733900544 00000100:00100000:0.0:1789127384.691358:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733900544 00010000:00010000:0.0:1789127384.691391:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173600/0xeeacf7c0243010f9 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d9d expref: 29 pid: 12098 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127384.691426:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 80 00000100:00100000:0.0:1789127384.691446:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df682e72580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+29:2349:x1876035733900544:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789127384.691458:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789127384.691464:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173600/0xeeacf7c0243010f9 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d9d expref: 29 pid: 12098 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127384.691476:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173600/0xeeacf7c0243010f9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d9d expref: 29 pid: 12098 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127384.691509:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df79f06c300) 00010000:00010000:0.0:1789127384.691514:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173e00/0xeeacf7c024301115 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127384.691524:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173e00/0xeeacf7c024301115 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127384.691531:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173e00/0xeeacf7c024301115 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127384.691549:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789127384.691602:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df682e72580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+29:2349:x1876035733900544:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 167us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127384.691610:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 80 00010000:00010000:3.0:1789127384.692240:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173600/0xeeacf7c0243010f9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d9d expref: 28 pid: 12098 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127384.692257:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae958f00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5830:1876035752770944:192.168.206.40@tcp:104: 00010000:00010000:3.0:1789127384.692275:0:5830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173e00/0xeeacf7c024301115 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.692284:0:5830:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173e00/0xeeacf7c024301115 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.692302:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173e00/0xeeacf7c024301115 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789127384.692319:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1789127384.692502:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173000/0xeeacf7c02430110e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7da4 expref: 29 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.692517:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173e00/0xeeacf7c024301115 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7da4 expref: 28 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.692526:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df79f06c300) 00010000:00010000:3.0:1789127384.692530:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789127384.692533:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7c2173e00, rc 0) 00000100:00100000:3.0:1789127384.692576:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6811c6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+28:11260:x1876035733900416:12345-192.168.206.40@tcp:101:bash.0 Request processed in 3867us (4048us total) trans 4294967473 rc 0/0 00000100:00100000:3.0:1789127384.692584:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 191 00000100:00100000:1.0:1789127384.694428:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127384.694568:0:12098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733900800 00000100:00100000:3.0:1789127384.694577:0:12098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733900800 00000100:00100000:3.0:1789127384.694776:0:12098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 192 00000100:00100000:3.0:1789127384.694822:0:12098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b43170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+28:11260:x1876035733900800:12345-192.168.206.40@tcp:36:bash.0 00010000:00010000:3.0:1789127384.695066:0:12098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2172c00/0xeeacf7c024301123 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.695082:0:12098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2172c00/0xeeacf7c024301123 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.695093:0:12098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2172c00/0xeeacf7c024301123 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789127384.695179:0:12098:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000004:00010000:3.0:1789127384.695206:0:12098:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000006ba64acc reply state 000000008423c2c7 transno 4294967475 ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2172c00/0xeeacf7c024301123 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127384.695214:0:12098:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1789127384.695257:0:12098:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000100:00100000:3.0:1789127384.695352:0:12098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b43170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+32:11260:x1876035733900800:12345-192.168.206.40@tcp:36:bash.0 Request processed in 567us (930us total) trans 4294967476 rc 0/0 00000100:00100000:3.0:1789127384.695360:0:12098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 192 00000020:00080000:3.0:1789127384.695365:0:12098:0:(tgt_main.c:785:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1789127384.697932:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2172c00/0xeeacf7c024301123 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.697948:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2172c00/0xeeacf7c024301123 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.697955:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2172c00/0xeeacf7c024301123 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.697961:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7c2172c00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:3.0:1789127384.697966:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2172c00/0xeeacf7c024301123 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.697973:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2172c00/0xeeacf7c024301123 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.697989:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df79f06c300) 00010000:00010000:3.0:1789127384.697992:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127384.697996:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2172c00/0xeeacf7c024301123 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.698021:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2172c00/0xeeacf7c024301123 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127384.698409:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127384.698482:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733900928 00000100:00100000:0.0:1789127384.698490:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733900928 00000100:00100000:0.0:1789127384.698542:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 193 00000100:00100000:0.0:1789127384.698551:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b4315e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+31:11260:x1876035733900928:12345-192.168.206.40@tcp:101:bash.0 00010000:00010000:0.0:1789127384.698573:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127384.698590:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728000/0xeeacf7c02430112a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7dab expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127384.698653:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728000/0xeeacf7c02430112a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7dab expref: 32 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127384.698667:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728000/0xeeacf7c02430112a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7dab expref: 32 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127384.698699:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df79f06c300) 00010000:00010000:0.0:1789127384.698702:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789127384.698705:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7ae728000, rc 0) 00000100:00100000:0.0:1789127384.698768:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b4315e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+32:11260:x1876035733900928:12345-192.168.206.40@tcp:101:bash.0 Request processed in 217us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127384.698775:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 193 00000100:00100000:1.0:1789127384.701217:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127384.701293:0:8063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733901056 00000100:00100000:3.0:1789127384.701302:0:8063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733901056 00000100:00100000:3.0:1789127384.701360:0:8063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 58 00000100:00100000:3.0:1789127384.701369:0:8063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79a384000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+7:11260:x1876035733901056:12345-192.168.206.40@tcp:101:bash.0 00010000:00010000:3.0:1789127384.701385:0:8063:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127384.701407:0:8063:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f22728c8/0xeeacf7c024301131 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7db2 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789127384.701432:0:8063:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aa3ead6, atime: 0x6aa3ead5, ctime: 0x6aa3ead6, blocks: 0xb 00010000:00010000:3.0:1789127384.701455:0:8063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=330s v=(0 0) 00010000:00010000:3.0:1789127384.701460:0:8063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127384.701469:0:8063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f22728c8/0xeeacf7c024301131 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7db2 expref: 8 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.701486:0:8063:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f22728c8/0xeeacf7c024301131 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7db2 expref: 8 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.701498:0:8063:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7c2173000, rc 0) 00000100:00100000:3.0:1789127384.701554:0:8063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79a384000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+8:11260:x1876035733901056:12345-192.168.206.40@tcp:101:bash.0 Request processed in 185us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127384.701561:0:8063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 58 00000100:00100000:2.0:1789127384.704338:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127384.704433:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733901184 00000100:00100000:1.0:1789127384.704443:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733901184 00002000:00010000:1.0:1789127384.704485:0:6694:0:(ofd_dev.c:2842:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:1.0:1789127384.704490:0:6694:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff8df6811c70c0 with x1876035733901184 ext(0->18446744073709551615) 00002000:00010000:1.0:1789127384.704501:0:6694:0:(ofd_dev.c:2847:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df6811c70c0. 00000100:00100000:1.0:1789127384.704549:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 5 00000100:00100000:1.0:1789127384.704559:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6811c70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+8:2348:x1876035733901184:12345-192.168.206.40@tcp:10:bash.0 00002000:00010000:1.0:1789127384.705074:0:6694:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1789127384.705092:0:6694:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1789127382 -> 1789127383 00002000:00010000:1.0:1789127384.705094:0:6694:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1789127381 -> 1789127381 00002000:00010000:1.0:1789127384.705097:0:6694:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1789127382 -> 1789127383 00002000:00010000:1.0:1789127384.705099:0:6694:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1789127384.705167:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6811c70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+9:2348:x1876035733901184:12345-192.168.206.40@tcp:10:bash.0 Request processed in 609us (835us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1789127384.705177:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 5 00002000:00010000:1.0:1789127384.705181:0:6694:0:(ofd_dev.c:2842:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:1.0:1789127384.705184:0:6694:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff8df6811c70c0 with x1876035733901184 ext(0->18446744073709551615) 00002000:00010000:1.0:1789127384.705189:0:6694:0:(ofd_dev.c:2847:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df6811c70c0. 00000100:00100000:1.0:1789127384.781768:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127384.781943:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733901312 00000100:00100000:3.0:1789127384.781952:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733901312 00000100:00100000:3.0:1789127384.782030:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 194 00000100:00100000:3.0:1789127384.782041:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79a385a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+32:11739:x1876035733901312:12345-192.168.206.40@tcp:34:lfs.0 00010000:00010000:3.0:1789127384.782113:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2172c00/0xeeacf7c024301138 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.782128:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2172c00/0xeeacf7c024301138 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.782140:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2172c00/0xeeacf7c024301138 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.782154:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173600/0xeeacf7c02430113f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.782162:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173600/0xeeacf7c02430113f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.782168:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173600/0xeeacf7c02430113f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.782447:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024301146 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.782457:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024301146 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.782464:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024301146 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789127384.782506:0:5830:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024301146 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.782517:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2172c00/0xeeacf7c024301138 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.782529:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2172c00/0xeeacf7c024301138 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.782536:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2172c00/0xeeacf7c024301138 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.782542:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7c2172c00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:3.0:1789127384.782546:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2172c00/0xeeacf7c024301138 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.782553:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2172c00/0xeeacf7c024301138 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.782564:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8df79f06cd00) 00010000:00010000:3.0:1789127384.782567:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127384.782572:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2172c00/0xeeacf7c024301138 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.782578:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2172c00/0xeeacf7c024301138 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.782592:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173600/0xeeacf7c02430113f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.782599:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173600/0xeeacf7c02430113f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.782604:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173600/0xeeacf7c02430113f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.782608:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7c2173600 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:3.0:1789127384.782618:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173600/0xeeacf7c02430113f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.782625:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173600/0xeeacf7c02430113f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.782633:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8df79f06c100) 00010000:00010000:3.0:1789127384.782635:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127384.782637:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173600/0xeeacf7c02430113f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.782655:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173600/0xeeacf7c02430113f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.782670:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024301146 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.782676:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024301146 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.782682:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024301146 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.782687:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df798df1c00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:3.0:1789127384.782690:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024301146 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.782695:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024301146 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.782703:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df79f06c300) 00010000:00010000:3.0:1789127384.782705:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127384.782716:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024301146 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.782721:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024301146 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127384.783077:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79a385a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+32:11739:x1876035733901312:12345-192.168.206.40@tcp:34:lfs.0 Request processed in 1034us (1315us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127384.783086:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 194 00000100:00100000:2.0:1789127384.840301:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127384.840375:0:12098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733901568 00000100:00100000:3.0:1789127384.840384:0:12098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733901568 00000100:00100000:3.0:1789127384.840443:0:12098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 195 00000100:00100000:3.0:1789127384.840453:0:12098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6811c61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+32:11742:x1876035733901568:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:3.0:1789127384.840471:0:12098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127384.840493:0:12098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c02430114d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7db9 expref: -99 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.840558:0:12098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024301154 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.840573:0:12098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024301154 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.840595:0:12098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024301154 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.840611:0:12098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c02430115b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.841478:0:12098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c02430115b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.841505:0:12098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c02430115b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.842218:0:12098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173600/0xeeacf7c024301162 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.842231:0:12098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173600/0xeeacf7c024301162 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.842239:0:12098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173600/0xeeacf7c024301162 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789127384.842249:0:12098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1789127384.842331:0:12098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024301154 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.842340:0:12098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024301154 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.842347:0:12098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024301154 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.842353:0:12098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df798df0200 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:3.0:1789127384.842357:0:12098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024301154 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.842364:0:12098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024301154 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.842376:0:12098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8df79f06cd00) 00010000:00010000:3.0:1789127384.842379:0:12098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127384.842389:0:12098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024301154 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.842395:0:12098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024301154 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.842409:0:12098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c02430115b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.842416:0:12098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c02430115b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.842422:0:12098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c02430115b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.842428:0:12098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df798df0800 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:3.0:1789127384.842431:0:12098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c02430115b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.842436:0:12098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c02430115b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.842444:0:12098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8df79f06c100) 00010000:00010000:3.0:1789127384.842446:0:12098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127384.842449:0:12098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c02430115b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.842454:0:12098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c02430115b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.842500:0:12098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c02430114d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7db9 expref: 35 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.842526:0:12098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173600/0xeeacf7c024301162 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7db9 expref: 34 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.842533:0:12098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df79f06c300) 00010000:00010000:3.0:1789127384.842535:0:12098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789127384.842537:0:12098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7c2173600, rc 0) 00000100:00100000:3.0:1789127384.842677:0:12098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6811c61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+34:11742:x1876035733901568:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 2224us (2383us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1789127384.842687:0:12098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 195 00000100:00100000:1.0:1789127384.846129:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127384.846238:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733901696 00000100:00100000:0.0:1789127384.846247:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733901696 00000100:00100000:0.0:1789127384.846355:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 196 00000100:00100000:0.0:1789127384.846366:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b4331a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+34:11742:x1876035733901696:12345-192.168.206.40@tcp:54:lfs.0 00010000:00010000:0.0:1789127384.846431:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728e00/0xeeacf7c024301170 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127384.846446:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173e00/0xeeacf7c024301115 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7da4 expref: 34 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127384.846455:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728e00/0xeeacf7c024301170 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127384.846488:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173e00/0xeeacf7c024301115 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7da4 expref: 34 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127384.846501:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173e00/0xeeacf7c024301115 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7da4 expref: 34 pid: 5830 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127384.846513:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df787b8de00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1876035752771072:192.168.206.40@tcp:104: 00000100:00100000:0.0:1789127384.846718:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7aeaafc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789127384.851099:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127384.851211:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df787b8de00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1876035752771072:192.168.206.40@tcp:104: 00010000:00010000:0.0:1789127384.851237:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728e00/0xeeacf7c024301170 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127384.851312:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733901952 00000100:00100000:3.0:1789127384.851319:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733901952 00000100:00100000:3.0:1789127384.851409:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 52 00000100:00100000:3.0:1789127384.851420:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b4333840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+35:5588:x1876035733901952:12345-192.168.206.40@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789127384.851972:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b4333840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+36:5588:x1876035733901952:12345-192.168.206.40@tcp:35:ldlm_bl.0 Request processed in 552us (881us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1789127384.851981:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 52 00000100:00100000:1.0:1789127384.855777:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127384.855928:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733902080 00000100:00100000:0.0:1789127384.855937:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733902080 00010000:00010000:0.0:1789127384.855974:0:8454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173e00/0xeeacf7c024301115 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7da4 expref: 36 pid: 5830 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127384.856047:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 81 00000100:00100000:0.0:1789127384.856056:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df68265cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+36:2349:x1876035733902080:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789127384.856070:0:8454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789127384.856076:0:8454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173e00/0xeeacf7c024301115 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7da4 expref: 36 pid: 5830 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127384.856088:0:8454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173e00/0xeeacf7c024301115 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7da4 expref: 36 pid: 5830 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127384.856112:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173e00/0xeeacf7c024301115 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7da4 expref: 36 pid: 5830 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127384.856127:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df79f06c300) 00010000:00010000:0.0:1789127384.856132:0:8454:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728e00/0xeeacf7c024301170 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127384.856140:0:8454:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728e00/0xeeacf7c024301170 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127384.856157:0:8454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728e00/0xeeacf7c024301170 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127384.856189:0:8454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789127384.856245:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df68265cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+35:2349:x1876035733902080:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 190us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127384.856253:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 81 00010000:00010000:1.0:1789127384.858167:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728e00/0xeeacf7c024301170 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127384.858181:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728e00/0xeeacf7c024301170 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127384.858212:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728e00/0xeeacf7c024301170 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127384.858219:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728e00/0xeeacf7c024301170 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127384.858226:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728e00/0xeeacf7c024301170 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127384.858233:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7ae728e00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:1.0:1789127384.858251:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728e00/0xeeacf7c024301170 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127384.858259:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728e00/0xeeacf7c024301170 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127384.858273:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df79f06c300) 00010000:00010000:1.0:1789127384.858276:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789127384.858281:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728e00/0xeeacf7c024301170 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127384.858287:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728e00/0xeeacf7c024301170 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127384.858377:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b4331a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+34:11742:x1876035733901696:12345-192.168.206.40@tcp:54:lfs.0 Request processed in 12010us (12251us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127384.858386:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 196 00000100:00100000:1.0:1789127384.866588:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127384.866984:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733902336 00000100:00100000:2.0:1789127384.866994:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733902336 00000100:00100000:2.0:1789127384.867083:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 53 00000100:00100000:2.0:1789127384.867094:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df68265ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+34:11742:x1876035733902336:12345-192.168.206.40@tcp:35:lfs.0 00000100:00100000:2.0:1789127384.867309:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df68265ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+35:11742:x1876035733902336:12345-192.168.206.40@tcp:35:lfs.0 Request processed in 216us (730us total) trans 4294967479 rc 0/0 00000100:00100000:2.0:1789127384.867318:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 53 00000100:00100000:3.0:1789127384.939386:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127384.939500:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733902592 00000100:00100000:1.0:1789127384.939508:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733902592 00000100:00100000:1.0:1789127384.939567:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 197 00000100:00100000:1.0:1789127384.939577:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae958f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+35:11753:x1876035733902592:12345-192.168.206.40@tcp:101:cat.0 00010000:00010000:1.0:1789127384.939609:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127384.939647:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024301177 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7dc0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127384.939725:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96800/0xeeacf7c02430117e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127384.939739:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96800/0xeeacf7c02430117e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127384.939765:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96800/0xeeacf7c02430117e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127384.939780:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96200/0xeeacf7c024301185 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127384.940026:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96200/0xeeacf7c024301185 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127384.940036:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96200/0xeeacf7c024301185 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127384.940325:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c02430118c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127384.940336:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c02430118c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127384.940343:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c02430118c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789127384.940352:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:1.0:1789127384.940435:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96800/0xeeacf7c02430117e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127384.940443:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96800/0xeeacf7c02430117e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127384.940450:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96800/0xeeacf7c02430117e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127384.940456:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd96800 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:1.0:1789127384.940466:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96800/0xeeacf7c02430117e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127384.940474:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96800/0xeeacf7c02430117e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127384.940487:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8df79f06cd00) 00010000:00010000:1.0:1789127384.940490:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789127384.940494:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96800/0xeeacf7c02430117e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127384.940500:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96800/0xeeacf7c02430117e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127384.940511:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96200/0xeeacf7c024301185 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127384.940517:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96200/0xeeacf7c024301185 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127384.940523:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96200/0xeeacf7c024301185 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127384.940529:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd96200 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:1.0:1789127384.940531:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96200/0xeeacf7c024301185 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127384.940537:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96200/0xeeacf7c024301185 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127384.940543:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8df782d66e00) 00010000:00010000:1.0:1789127384.940546:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789127384.940554:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96200/0xeeacf7c024301185 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127384.940560:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96200/0xeeacf7c024301185 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127384.940599:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024301177 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7dc0 expref: 38 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127384.940934:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c02430118c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7dc0 expref: 37 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127384.940946:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df79f06c300) 00010000:00010000:1.0:1789127384.940948:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789127384.940950:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7bbd97600, rc 0) 00000100:00100000:1.0:1789127384.941016:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae958f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+37:11753:x1876035733902592:12345-192.168.206.40@tcp:101:cat.0 Request processed in 1440us (1639us total) trans 4294967480 rc 0/0 00000100:00100000:1.0:1789127384.941025:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 197 00000100:00100000:1.0:1789127384.948665:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127384.948837:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733902848 00000100:00100000:3.0:1789127384.948846:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733902848 00000100:00100000:3.0:1789127384.948902:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 54 00000100:00100000:3.0:1789127384.948911:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df68265f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+37:11753:x1876035733902848:12345-192.168.206.40@tcp:35:cat.0 00000100:00100000:3.0:1789127384.949129:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df68265f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+38:11753:x1876035733902848:12345-192.168.206.40@tcp:35:cat.0 Request processed in 218us (471us total) trans 4294967481 rc 0/0 00000100:00100000:3.0:1789127384.949136:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 54 00000100:00100000:2.0:1789127384.974582:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127384.974720:0:12098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733903104 00000100:00100000:3.0:1789127384.974729:0:12098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733903104 00000100:00100000:3.0:1789127384.974816:0:12098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 198 00000100:00100000:3.0:1789127384.974827:0:12098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6811c5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+38:11754:x1876035733903104:12345-192.168.206.40@tcp:36:rm.0 00010000:00010000:3.0:1789127384.974881:0:12098:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789127384.974907:0:12098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c02430118c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7dc0 expref: 38 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.974929:0:12098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173600/0xeeacf7c024301162 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7db9 expref: 37 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.974942:0:12098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728000/0xeeacf7c02430112a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7dab expref: 36 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.974952:0:12098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df79f06c300) 00010000:00010000:3.0:1789127384.974963:0:12098:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789127384.974983:0:12098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c02430119a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.974995:0:12098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c02430119a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.975004:0:12098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c02430119a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.975017:0:12098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c0243011a1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.975024:0:12098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c0243011a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.975049:0:12098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c0243011a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.975331:0:12098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c0243011a8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.975340:0:12098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c0243011a8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.975347:0:12098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c0243011a8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789127384.975983:0:12098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:3.0:1789127384.975994:0:12098:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 331132204883ns, next at 332132202184ns, rc = 0 00010000:00010000:3.0:1789127384.976054:0:12098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173e00/0xeeacf7c0243011af lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.976063:0:12098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173e00/0xeeacf7c0243011af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.976071:0:12098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173e00/0xeeacf7c0243011af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.976077:0:12098:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173e00/0xeeacf7c0243011af lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.976082:0:12098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173e00/0xeeacf7c0243011af lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.976087:0:12098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173e00/0xeeacf7c0243011af lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.976108:0:12098:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789127384.976127:0:12098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c0243011a8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.976133:0:12098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c0243011a8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.976139:0:12098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c0243011a8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.976145:0:12098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df798df0200 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:3.0:1789127384.976149:0:12098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c0243011a8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.976158:0:12098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c0243011a8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.976168:0:12098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df79f06c200) 00010000:00010000:3.0:1789127384.976171:0:12098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789127384.976175:0:12098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c0243011a8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.976181:0:12098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c0243011a8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.976198:0:12098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c02430119a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.976204:0:12098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c02430119a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.976220:0:12098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c02430119a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.976226:0:12098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df798df1c00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:3.0:1789127384.976229:0:12098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c02430119a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.976235:0:12098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c02430119a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.976242:0:12098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8df79f06cd00) 00010000:00010000:3.0:1789127384.976245:0:12098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127384.976247:0:12098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c02430119a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.976253:0:12098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c02430119a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789127384.976263:0:12098:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000006c332662 reply state 00000000cf3cf42e transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c0243011a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127384.976271:0:12098:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789127384.976354:0:12098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6811c5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+37:11754:x1876035733903104:12345-192.168.206.40@tcp:36:rm.0 Request processed in 1527us (1779us total) trans 4294967482 rc 0/0 00000100:00100000:3.0:1789127384.976365:0:12098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 198 00010000:00010000:0.0:1789127384.976915:0:8511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789127384.976923:0:8511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173e00/0xeeacf7c0243011af lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127384.976931:0:8511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7c2173e00 already unused, calling callback (ffffffffc17a4550) 00010000:00010000:0.0:1789127384.976935:0:8511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173e00/0xeeacf7c0243011af lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127384.976942:0:8511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173e00/0xeeacf7c0243011af lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127384.976953:0:8511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df79f06c200) 00010000:00010000:0.0:1789127384.976955:0:8511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789127384.976959:0:8511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173e00/0xeeacf7c0243011af lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127384.976965:0:8511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173e00/0xeeacf7c0243011af lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127384.976983:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127384.976985:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127384.976987:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127384.982297:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c0243011a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.982312:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c0243011a1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.982336:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c0243011a1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.982342:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df798df0800 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:3.0:1789127384.982347:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c0243011a1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.982355:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c0243011a1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.982370:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8df79f06c100) 00010000:00010000:3.0:1789127384.982373:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127384.982378:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c0243011a1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127384.982383:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c0243011a1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127385.015873:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127385.015979:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733903360 00000100:00100000:1.0:1789127385.015989:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733903360 00000100:00100000:1.0:1789127385.016052:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 199 00000100:00100000:1.0:1789127385.016062:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6811c52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+36:11760:x1876035733903360:12345-192.168.206.40@tcp:101:bash.0 00010000:00010000:1.0:1789127385.016084:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127385.016104:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96800/0xeeacf7c0243011b6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7dc7 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127385.016224:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c0243011bd lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127385.016252:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c0243011bd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127385.016263:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c0243011bd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127385.016278:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c0243011c4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127385.016285:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c0243011c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127385.016291:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c0243011c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789127385.016784:0:5832:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:1.0:1789127385.016961:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c0243011cb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127385.016970:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c0243011cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127385.016978:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c0243011cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127385.017009:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c0243011bd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127385.017016:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c0243011bd lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127385.017022:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c0243011bd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127385.017034:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd97800 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:1.0:1789127385.017038:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c0243011bd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127385.017045:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c0243011bd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127385.017056:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8df79f06cd00) 00010000:00010000:1.0:1789127385.017058:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789127385.017063:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c0243011bd lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127385.017069:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c0243011bd lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789127385.017082:0:5832:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000abee61db reply state 000000003f7dc584 transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c0243011c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127385.017090:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789127385.017115:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96800/0xeeacf7c0243011b6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7dc7 expref: 39 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127385.017127:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c0243011cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7dc7 expref: 38 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127385.017134:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8df782d66c00) 00010000:00010000:1.0:1789127385.017136:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789127385.017138:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7bbd97e00, rc 0) 00000100:00100000:1.0:1789127385.017209:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6811c52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+39:11760:x1876035733903360:12345-192.168.206.40@tcp:101:bash.0 Request processed in 1147us (1346us total) trans 4294967483 rc 0/0 00000100:00100000:1.0:1789127385.017223:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 199 00000100:00080000:2.0:1789127385.017366:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789127385.022046:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c0243011c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127385.022064:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c0243011c4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127385.022072:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c0243011c4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127385.022083:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd96a00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:3.0:1789127385.022088:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c0243011c4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127385.022114:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c0243011c4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127385.022131:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8df782d66e00) 00010000:00010000:3.0:1789127385.022135:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127385.022140:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c0243011c4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127385.022147:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c0243011c4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127385.024451:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127385.024527:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733903488 00000100:00100000:3.0:1789127385.024536:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733903488 00000100:00100000:3.0:1789127385.024608:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 59 00000100:00100000:3.0:1789127385.024624:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6827c3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+7:2347:x1876035733903488:12345-192.168.206.40@tcp:101:bash.0 00010000:00010000:3.0:1789127385.024653:0:6689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127385.024672:0:6689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b2133a8/0xeeacf7c0243011d9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7dce expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789127385.024698:0:6689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789127385.024717:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=331s v=(0 0) 00010000:00010000:3.0:1789127385.024722:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127385.024732:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b2133a8/0xeeacf7c0243011d9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7dce expref: 8 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127385.024753:0:6689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000b2133a8/0xeeacf7c0243011d9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7dce expref: 8 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127385.024778:0:6689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7c2173600, rc 0) 00000100:00100000:3.0:1789127385.024866:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6827c3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+8:2347:x1876035733903488:12345-192.168.206.40@tcp:101:bash.0 Request processed in 244us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127385.024873:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 59 00000100:00080000:2.0:1789127385.025288:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789127385.027247:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127385.027399:0:8063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733903616 00000100:00100000:3.0:1789127385.027407:0:8063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733903616 00000100:00100000:3.0:1789127385.027459:0:8063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 60 00000100:00100000:3.0:1789127385.027468:0:8063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6827c0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+8:11760:x1876035733903616:12345-192.168.206.40@tcp:101:bash.0 00010000:00010000:3.0:1789127385.027484:0:8063:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127385.027500:0:8063:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fcf686e/0xeeacf7c0243011e0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7dd5 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127385.027527:0:8063:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000b2133a8/0xeeacf7c0243011d9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7dce expref: 9 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127385.027534:0:8063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127385.027538:0:8063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127385.027543:0:8063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005fcf686e/0xeeacf7c0243011e0 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7dd5 expref: 9 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127385.027570:0:8063:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000b2133a8/0xeeacf7c0243011d9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7dce expref: 9 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127385.027582:0:8063:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000b2133a8/0xeeacf7c0243011d9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7dce expref: 9 pid: 6689 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127385.027606:0:8063:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7aeaba940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8063:1876035752771200:192.168.206.40@tcp:104: 00000100:00100000:3.0:1789127385.031354:0:8063:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7a037c840 going to sleep for 11 seconds 00000100:00100000:0.0:1789127385.034764:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127385.035266:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733903744 00000100:00100000:1.0:1789127385.035276:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733903744 00010000:00010000:1.0:1789127385.035314:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000b2133a8/0xeeacf7c0243011d9 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7dce expref: 10 pid: 6689 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127385.035358:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 82 00000100:00100000:1.0:1789127385.035374:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df787b8de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+10:2348:x1876035733903744:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789127385.035388:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789127385.035408:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000b2133a8/0xeeacf7c0243011d9 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7dce expref: 10 pid: 6689 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127385.035421:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000b2133a8/0xeeacf7c0243011d9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7dce expref: 10 pid: 6689 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127385.035455:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789127385.035459:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789127385.035466:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005fcf686e/0xeeacf7c0243011e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7dd5 expref: 10 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127385.035475:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005fcf686e/0xeeacf7c0243011e0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7dd5 expref: 10 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127385.035508:0:5816:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000005fcf686e/0xeeacf7c0243011e0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7dd5 expref: 10 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127385.035535:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df68265fc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5816:1876035752771328:192.168.206.40@tcp:105: 00000100:00100000:1.0:1789127385.035624:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7984ccd80 going to sleep for 11 seconds 00010000:00010000:3.0:1789127385.037782:0:8063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b2133a8/0xeeacf7c0243011d9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7dce expref: 10 pid: 6689 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127385.038023:0:8063:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7aeaba940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8063:1876035752771200:192.168.206.40@tcp:104: 00010000:00010000:3.0:1789127385.038055:0:8063:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005fcf686e/0xeeacf7c0243011e0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7dd5 expref: 9 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127385.038069:0:8063:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7c2172c00, rc 0) 00000100:00100000:3.0:1789127385.038133:0:8063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6827c0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+9:11760:x1876035733903616:12345-192.168.206.40@tcp:101:bash.0 Request processed in 10665us (10893us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127385.038141:0:8063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 60 00000100:00100000:0.0:1789127385.042327:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df68265fc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5816:1876035752771328:192.168.206.40@tcp:105: 00010000:00010000:0.0:1789127385.042355:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789127385.042430:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df787b8de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+8:2348:x1876035733903744:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 7062us (7674us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127385.042440:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 82 00000100:00100000:1.0:1789127385.044401:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127385.044473:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733904000 00000100:00100000:3.0:1789127385.044483:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733904000 00000100:00100000:3.0:1789127385.044536:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 55 00000100:00100000:3.0:1789127385.044546:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df68265cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+38:11760:x1876035733904000:12345-192.168.206.40@tcp:35:bash.0 00000100:00100000:3.0:1789127385.044931:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df68265cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+39:11760:x1876035733904000:12345-192.168.206.40@tcp:35:bash.0 Request processed in 385us (536us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1789127385.044938:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 55 00000040:00080000:2.0:1789127385.140899:0:12084:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789127385.140908:0:12084:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789127385.141071:0:12084:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1789127385.141076:0:12084:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789127385.169530:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127385.169650:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733904128 00000100:00100000:1.0:1789127385.169660:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733904128 00000100:00100000:1.0:1789127385.169718:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 200 00000100:00100000:1.0:1789127385.169728:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6827c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+39:11776:x1876035733904128:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:1.0:1789127385.169751:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127385.169771:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97a00/0xeeacf7c0243011e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7ddc expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127385.169856:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96400/0xeeacf7c0243011ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127385.169870:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96400/0xeeacf7c0243011ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127385.169882:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96400/0xeeacf7c0243011ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789127385.169937:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:1.0:1789127385.169942:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1789127385.169964:0:5830:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96400/0xeeacf7c0243011ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127385.169990:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97a00/0xeeacf7c0243011e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7ddc expref: 41 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127385.170029:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96400/0xeeacf7c0243011ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7ddc expref: 40 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127385.170038:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8df79f06cd00) 00010000:00010000:1.0:1789127385.170041:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789127385.170045:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7bbd96400, rc 0) 00000100:00100000:1.0:1789127385.170111:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6827c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+40:11776:x1876035733904128:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 384us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127385.170117:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 200 00000100:00100000:1.0:1789127385.174476:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127385.174566:0:10285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733904384 00000100:00100000:2.0:1789127385.174575:0:10285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733904384 00000100:00100000:2.0:1789127385.174635:0:10285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 201 00000100:00100000:2.0:1789127385.174654:0:10285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df68265f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+40:11776:x1876035733904384:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:2.0:1789127385.174672:0:10285:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127385.174691:0:10285:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7000/0xeeacf7c0243011f5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7de3 expref: -99 pid: 10285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127385.174823:0:10285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6800/0xeeacf7c0243011fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127385.174836:0:10285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6800/0xeeacf7c0243011fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127385.174847:0:10285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6800/0xeeacf7c0243011fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789127385.174857:0:10285:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1789127385.174975:0:10285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7000/0xeeacf7c0243011f5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7de3 expref: 43 pid: 10285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127385.174993:0:10285:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6800/0xeeacf7c0243011fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7de3 expref: 42 pid: 10285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127385.175018:0:10285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8df782d66c00) 00010000:00010000:2.0:1789127385.175021:0:10285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789127385.175024:0:10285:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7aeab6800, rc 0) 00000100:00100000:2.0:1789127385.175076:0:10285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df68265f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+42:11776:x1876035733904384:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 424us (609us total) trans 4294967485 rc 0/0 00000100:00100000:2.0:1789127385.175083:0:10285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 201 00000100:00100000:2.0:1789127385.179003:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127385.179085:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733904640 00000100:00100000:0.0:1789127385.179094:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733904640 00000100:00100000:0.0:1789127385.179147:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 202 00000100:00100000:0.0:1789127385.179157:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6827c21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+42:11776:x1876035733904640:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:0.0:1789127385.179178:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127385.179197:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c02430120a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7dea expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127385.179279:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729400/0xeeacf7c024301211 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127385.179293:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729400/0xeeacf7c024301211 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127385.179304:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729400/0xeeacf7c024301211 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789127385.179316:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1789127385.179442:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c02430120a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7dea expref: 45 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127385.179460:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729400/0xeeacf7c024301211 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7dea expref: 44 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127385.179487:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8df782d66c00) 00010000:00010000:0.0:1789127385.179490:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789127385.179493:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7ae729400, rc 0) 00000100:00100000:0.0:1789127385.179556:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6827c21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+44:11776:x1876035733904640:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 400us (561us total) trans 4294967486 rc 0/0 00000100:00100000:0.0:1789127385.179563:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 202 00000100:00100000:0.0:1789127385.191250:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127385.191300:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127385.191439:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733904768 00000100:00100000:3.0:1789127385.191449:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733904768 00000100:00100000:3.0:1789127385.191497:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 61 00000100:00100000:3.0:1789127385.191512:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6822a3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+8:2349:x1876035733904768:12345-192.168.206.40@tcp:1:lfs.0 00010000:00010000:3.0:1789127385.191549:0:6689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b2133a8/0xeeacf7c02430121f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127385.191566:0:6689:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005fcf686e/0xeeacf7c0243011e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7dd5 expref: 8 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127385.191575:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127385.191588:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789127385.191593:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b2133a8/0xeeacf7c02430121f lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127385.191627:0:6689:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005fcf686e/0xeeacf7c0243011e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7dd5 expref: 8 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127385.191651:0:6689:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005fcf686e/0xeeacf7c0243011e0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7dd5 expref: 8 pid: 8063 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127385.191665:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7aeaba940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6689:1876035752771456:192.168.206.40@tcp:104: 00000100:00100000:3.0:1789127385.191752:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7a037cf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789127385.192191:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733904896 00000100:00100000:2.0:1789127385.192197:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733904896 00000100:00100000:2.0:1789127385.192240:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 14 00000100:00100000:2.0:1789127385.192247:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7889c8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+44:2348:x1876035733904896:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789127385.192257:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789127385.192277:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6800/0xeeacf7c0243011fc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7de3 expref: 44 pid: 10285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127385.192291:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8df782d66c00) 00010000:00010000:2.0:1789127385.192296:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789127385.192339:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7889c8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+43:2348:x1876035733904896:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 92us (1037us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127385.192346:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 14 00000100:00100000:3.0:1789127385.194844:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7aeaba940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6689:1876035752771456:192.168.206.40@tcp:104: 00010000:00010000:3.0:1789127385.194870:0:6689:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000b2133a8/0xeeacf7c02430121f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127385.196352:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127385.200465:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733905024 00000100:00100000:1.0:1789127385.200478:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733905024 00002000:00100000:1.0:1789127385.200534:0:6693:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8df6822a0f00 x1876035733905024/t0(0) o4->28762f98-a240-4662-a754-e28bbeb6cb4b@192.168.206.40@tcp:121/0 lens 504/0 e 0 to 0 dl 1789127396 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789127385.200544:0:6693:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff8df6822a0f00 with x1876035733905024 ext(0->8) 00010000:00010000:1.0:1789127385.200552:0:6693:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000005fcf686e/0xeeacf7c0243011e0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7dd5 expref: 9 pid: 8063 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127385.200569:0:6693:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000005fcf686e/0xeeacf7c0243011e0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7dd5 expref: 9 pid: 8063 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789127385.200589:0:6693:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8df6822a0f00 00000100:00100000:1.0:1789127385.200730:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 3 00000100:00100000:1.0:1789127385.200741:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6822a0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+9:2349:x1876035733905024:12345-192.168.206.40@tcp:4:lfs.0 00000100:00100000:1.0:1789127385.201200:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6822a0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+11:2349:x1876035733905024:12345-192.168.206.40@tcp:4:lfs.0 Request processed in 458us (4853us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1789127385.201214:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 3 00002000:00100000:1.0:1789127385.201222:0:6693:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8df6822a0f00 x1876035733905024/t4294967308(0) o4->28762f98-a240-4662-a754-e28bbeb6cb4b@192.168.206.40@tcp:121/0 lens 504/448 e 0 to 0 dl 1789127396 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789127385.201231:0:6693:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff8df6822a0f00 with x1876035733905024 ext(0->8) 00010000:00010000:1.0:1789127385.201237:0:6693:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000005fcf686e/0xeeacf7c0243011e0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7dd5 expref: 11 pid: 8063 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127385.201249:0:6693:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000005fcf686e/0xeeacf7c0243011e0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7dd5 expref: 11 pid: 8063 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789127385.201256:0:6693:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8df6822a0f00 00000100:00100000:0.0:1789127385.204890:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127385.204978:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733905152 00000100:00100000:2.0:1789127385.204987:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733905152 00010000:00010000:2.0:1789127385.205027:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005fcf686e/0xeeacf7c0243011e0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7dd5 expref: 11 pid: 8063 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127385.205120:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 83 00000100:00100000:2.0:1789127385.205130:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6822a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+11:2346:x1876035733905152:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789127385.205145:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789127385.205164:0:5815:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1789127385.205167:0:5815:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1789127384 00002000:00010000:2.0:1789127385.205169:0:5815:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1789127384 00002000:00010000:2.0:1789127385.205171:0:5815:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1789127384 00010000:00010000:2.0:1789127385.205178:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005fcf686e/0xeeacf7c0243011e0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7dd5 expref: 11 pid: 8063 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127385.205191:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005fcf686e/0xeeacf7c0243011e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7dd5 expref: 11 pid: 8063 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127385.205213:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fcf686e/0xeeacf7c0243011e0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7dd5 expref: 11 pid: 8063 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127385.205230:0:5815:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789127385.205235:0:5815:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789127385.205241:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000b2133a8/0xeeacf7c02430121f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127385.205251:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b2133a8/0xeeacf7c02430121f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127385.205397:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789127385.205482:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6822a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+10:2346:x1876035733905152:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 353us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127385.205491:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 83 00010000:00010000:3.0:1789127385.207051:0:6689:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000b2133a8/0xeeacf7c02430121f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127385.207083:0:6689:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b2133a8/0xeeacf7c02430121f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127385.207114:0:6689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b2133a8/0xeeacf7c02430121f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127385.207121:0:6689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b2133a8/0xeeacf7c02430121f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127385.207130:0:6689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b2133a8/0xeeacf7c02430121f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127385.207137:0:6689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7c2173600 already unused, calling callback (ffffffffc17a4550) 00010000:00010000:3.0:1789127385.207141:0:6689:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b2133a8/0xeeacf7c02430121f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127385.207151:0:6689:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b2133a8/0xeeacf7c02430121f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127385.207168:0:6689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b2133a8/0xeeacf7c02430121f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127385.207176:0:6689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b2133a8/0xeeacf7c02430121f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127385.207383:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6822a3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+9:2349:x1876035733904768:12345-192.168.206.40@tcp:1:lfs.0 Request processed in 15869us (16138us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127385.207392:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 61 00000100:00100000:0.0:1789127385.210274:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127385.210712:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733905408 00000100:00100000:3.0:1789127385.210723:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733905408 00000100:00100000:3.0:1789127385.210967:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 56 00000100:00100000:3.0:1789127385.210978:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79156a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+43:11776:x1876035733905408:12345-192.168.206.40@tcp:35:lfs.0 00000004:00010000:3.0:1789127385.211039:0:5833:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729400/0xeeacf7c024301211 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7dea expref: 43 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789127385.211264:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:3.0:1789127385.211303:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:3.0:1789127385.211912:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00010000:00010000:3.0:1789127385.211971:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173e00/0xeeacf7c024301226 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127385.211987:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c0243011cb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7dc7 expref: 47 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127385.211995:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173e00/0xeeacf7c024301226 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127385.212026:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c0243011cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7dc7 expref: 47 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127385.212040:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c0243011cb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7dc7 expref: 47 pid: 5832 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127385.212073:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7aeaba940 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5833:1876035752771584:192.168.206.40@tcp:104: 00000100:00100000:3.0:1789127385.212156:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7a037cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1789127385.218412:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127385.218584:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733905536 00000100:00100000:2.0:1789127385.218593:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733905536 00010000:00010000:2.0:1789127385.218654:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c0243011cb lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7dc7 expref: 48 pid: 5832 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127385.218693:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 84 00000100:00100000:2.0:1789127385.218702:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6822a21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+48:2349:x1876035733905536:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789127385.218716:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789127385.218723:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c0243011cb lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7dc7 expref: 48 pid: 5832 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127385.218736:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c0243011cb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7dc7 expref: 48 pid: 5832 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127385.218758:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8df782d66c00) 00010000:00010000:2.0:1789127385.218763:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173e00/0xeeacf7c024301226 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127385.218772:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173e00/0xeeacf7c024301226 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127385.218779:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173e00/0xeeacf7c024301226 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127385.218835:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789127385.218883:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6822a21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+48:2349:x1876035733905536:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 180us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127385.218903:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 84 00010000:00010000:3.0:1789127385.219110:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c0243011cb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7dc7 expref: 47 pid: 5832 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127385.219127:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7aeaba940 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5833:1876035752771584:192.168.206.40@tcp:104: 00010000:00010000:3.0:1789127385.219145:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173e00/0xeeacf7c024301226 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127385.219154:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173e00/0xeeacf7c024301226 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127385.219159:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173e00/0xeeacf7c024301226 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789127385.219271:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000001:00080000:3.0:1789127385.219484:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:3.0:1789127385.219582:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7aeaba940 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5833:1876035752771712:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789127385.219647:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127385.219679:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7a037c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789127385.219851:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752771712 00000100:00100000:0.0:1789127385.219856:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752771712 00000100:00100000:0.0:1789127385.219907:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789127385.219914:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeab8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5833:x1876035752771712:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789127385.219976:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeab8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5833:x1876035752771712:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 63us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127385.219983:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1789127385.220107:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789127385.220183:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7aeaba940 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5833:1876035752771712:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1789127385.221027:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:3.0:1789127385.221091:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7aeaba940 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5833:1876035752771840:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789127385.221130:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127385.221149:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7a037cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1789127385.221539:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752771840 00000100:00100000:0.0:1789127385.221545:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752771840 00000100:00100000:0.0:1789127385.221580:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789127385.221587:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79a3a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5833:x1876035752771840:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789127385.221769:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79a3a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:5833:x1876035752771840:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 182us (637us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1789127385.221828:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789127385.222783:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7aeaba940 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5833:1876035752771840:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1789127385.222875:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:1.0:1789127385.222921:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173e00/0xeeacf7c024301226 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127385.222930:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173e00/0xeeacf7c024301226 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127385.222937:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173e00/0xeeacf7c024301226 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127385.222943:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7c2173e00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:1.0:1789127385.222947:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173e00/0xeeacf7c024301226 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127385.222955:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173e00/0xeeacf7c024301226 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127385.222981:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8df782d66c00) 00010000:00010000:1.0:1789127385.222984:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1789127385.222989:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173e00/0xeeacf7c024301226 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127385.222995:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173e00/0xeeacf7c024301226 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789127385.223175:0:5833:0:(mdd_object.c:4024:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1789127385.223273:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:1.0:1789127385.223283:0:5833:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 331379494174ns, next at 332379492172ns, rc = 0 00000001:00080000:1.0:1789127385.223290:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:1.0:1789127385.223319:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8df782d66c00) 00010000:00010000:1.0:1789127385.223322:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789127385.223329:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729400/0xeeacf7c024301211 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7dea expref: 51 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127385.223424:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79156a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+50:11776:x1876035733905408:12345-192.168.206.40@tcp:35:lfs.0 Request processed in 12447us (13156us total) trans 4294967495 rc 0/0 00000100:00100000:1.0:1789127385.223518:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 56 00000020:00080000:1.0:1789127385.223524:0:5833:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1789127385.225936:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127385.226022:0:12098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733905664 00000100:00100000:3.0:1789127385.226041:0:12098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733905664 00000100:00100000:3.0:1789127385.226092:0:12098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 203 00000100:00100000:3.0:1789127385.226101:0:12098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6822a12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+50:11776:x1876035733905664:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:3.0:1789127385.226121:0:12098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127385.226142:0:12098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173600/0xeeacf7c02430122d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7df1 expref: -99 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127385.226195:0:12098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173600/0xeeacf7c02430122d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7df1 expref: 51 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127385.226209:0:12098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173600/0xeeacf7c02430122d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7df1 expref: 51 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127385.226227:0:12098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8df79f06c100) 00010000:00010000:3.0:1789127385.226230:0:12098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789127385.226234:0:12098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7c2173600, rc 0) 00000100:00100000:3.0:1789127385.226287:0:12098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6822a12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+51:11776:x1876035733905664:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 187us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127385.226294:0:12098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 203 00000100:00100000:0.0:1789127385.229173:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127385.229256:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733905920 00000100:00100000:2.0:1789127385.229265:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733905920 00000100:00100000:2.0:1789127385.229318:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 57 00000100:00100000:2.0:1789127385.229327:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6822a1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+51:11776:x1876035733905920:12345-192.168.206.40@tcp:35:lfs.0 00000100:00100000:2.0:1789127385.229540:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6822a1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+52:11776:x1876035733905920:12345-192.168.206.40@tcp:35:lfs.0 Request processed in 214us (374us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1789127385.229548:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 57 00000100:00100000:1.0:1789127385.308421:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127385.308537:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733906048 00000100:00100000:0.0:1789127385.308546:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733906048 00000100:00100000:0.0:1789127385.308606:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 204 00000100:00100000:0.0:1789127385.308627:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df68265ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+52:11786:x1876035733906048:12345-192.168.206.40@tcp:34:lfs.0 00010000:00010000:0.0:1789127385.308712:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728400/0xeeacf7c024301234 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127385.308729:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728400/0xeeacf7c024301234 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127385.308742:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728400/0xeeacf7c024301234 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127385.308758:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728a00/0xeeacf7c02430123b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127385.308765:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728a00/0xeeacf7c02430123b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127385.308771:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728a00/0xeeacf7c02430123b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127385.308913:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729a00/0xeeacf7c024301242 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127385.308921:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729a00/0xeeacf7c024301242 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127385.308947:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729a00/0xeeacf7c024301242 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789127385.308991:0:5832:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729a00/0xeeacf7c024301242 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127385.309003:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728400/0xeeacf7c024301234 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127385.309008:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728400/0xeeacf7c024301234 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127385.309014:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728400/0xeeacf7c024301234 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127385.309020:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7ae728400 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:0.0:1789127385.309025:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728400/0xeeacf7c024301234 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127385.309033:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728400/0xeeacf7c024301234 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127385.309044:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8df79f06cd00) 00010000:00010000:0.0:1789127385.309047:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127385.309051:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728400/0xeeacf7c024301234 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127385.309058:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728400/0xeeacf7c024301234 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127385.309070:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728a00/0xeeacf7c02430123b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127385.309081:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728a00/0xeeacf7c02430123b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127385.309087:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728a00/0xeeacf7c02430123b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127385.309091:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7ae728a00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:0.0:1789127385.309094:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728a00/0xeeacf7c02430123b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127385.309100:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728a00/0xeeacf7c02430123b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127385.309106:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8df782a68800) 00010000:00010000:0.0:1789127385.309109:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127385.309112:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728a00/0xeeacf7c02430123b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127385.309117:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728a00/0xeeacf7c02430123b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127385.309131:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729a00/0xeeacf7c024301242 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127385.309137:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729a00/0xeeacf7c024301242 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127385.309143:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729a00/0xeeacf7c024301242 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127385.309147:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7ae729a00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:0.0:1789127385.309156:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729a00/0xeeacf7c024301242 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127385.309162:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729a00/0xeeacf7c024301242 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127385.309170:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8df79f06c100) 00010000:00010000:0.0:1789127385.309173:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127385.309176:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729a00/0xeeacf7c024301242 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127385.309181:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729a00/0xeeacf7c024301242 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127385.309245:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df68265ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+52:11786:x1876035733906048:12345-192.168.206.40@tcp:34:lfs.0 Request processed in 629us (831us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127385.309253:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 204 00000100:00100000:0.0:1789127385.322159:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127385.322195:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127385.322227:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127385.322307:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733906304 00000100:00100000:2.0:1789127385.322316:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733906304 00000100:00100000:2.0:1789127385.322376:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 81 00000100:00100000:2.0:1789127385.322385:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6822a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+9:2346:x1876035733906304:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:2.0:1789127385.322462:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6822a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+9:2346:x1876035733906304:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 77us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127385.322470:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 81 00000100:00100000:3.0:1789127385.322576:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733906176 00000100:00100000:3.0:1789127385.322589:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733906176 00000100:00100000:3.0:1789127385.322628:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 327 00000100:00100000:3.0:1789127385.322634:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df787bba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d829a69b-d740-4e4c-8301-ef09c9d45165+13:2346:x1876035733906176:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:3.0:1789127385.322671:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df787bba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d829a69b-d740-4e4c-8301-ef09c9d45165+13:2346:x1876035733906176:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 37us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127385.322677:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 327 00000100:00100000:1.0:1789127385.322975:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733906432 00000100:00100000:1.0:1789127385.322980:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733906432 00000100:00100000:1.0:1789127385.323016:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 161 00000100:00100000:1.0:1789127385.323022:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6822a1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81b0e267-d7e0-4043-b34e-eec2dc4c5a6b+5:2346:x1876035733906432:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:1.0:1789127385.323059:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6822a1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81b0e267-d7e0-4043-b34e-eec2dc4c5a6b+5:2346:x1876035733906432:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 37us (863us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127385.323077:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 161 00000100:00080000:0.0:1789127385.323733:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789127385.323738:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789127385.351858:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127385.351947:0:10285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733906688 00000100:00100000:2.0:1789127385.351956:0:10285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733906688 00000100:00100000:2.0:1789127385.352010:0:10285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 205 00000100:00100000:2.0:1789127385.352019:0:10285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6822a03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+52:11789:x1876035733906688:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:2.0:1789127385.352039:0:10285:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127385.352060:0:10285:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6000/0xeeacf7c024301249 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7df8 expref: -99 pid: 10285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127385.352127:0:10285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7c00/0xeeacf7c024301250 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127385.352155:0:10285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7c00/0xeeacf7c024301250 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127385.352167:0:10285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7c00/0xeeacf7c024301250 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127385.352183:0:10285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6400/0xeeacf7c024301257 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127385.352190:0:10285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6400/0xeeacf7c024301257 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127385.352197:0:10285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6400/0xeeacf7c024301257 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127385.352317:0:10285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7800/0xeeacf7c02430125e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127385.352326:0:10285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7800/0xeeacf7c02430125e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127385.352333:0:10285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7800/0xeeacf7c02430125e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789127385.352343:0:10285:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1789127385.352444:0:10285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7c00/0xeeacf7c024301250 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127385.352451:0:10285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7c00/0xeeacf7c024301250 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127385.352457:0:10285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7c00/0xeeacf7c024301250 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127385.352469:0:10285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7aeab7c00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:2.0:1789127385.352474:0:10285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7c00/0xeeacf7c024301250 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127385.352481:0:10285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7c00/0xeeacf7c024301250 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127385.352493:0:10285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8df79f06cd00) 00010000:00010000:2.0:1789127385.352496:0:10285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789127385.352500:0:10285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7c00/0xeeacf7c024301250 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127385.352506:0:10285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7c00/0xeeacf7c024301250 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127385.352517:0:10285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6400/0xeeacf7c024301257 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127385.352522:0:10285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6400/0xeeacf7c024301257 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127385.352528:0:10285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6400/0xeeacf7c024301257 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127385.352532:0:10285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7aeab6400 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:2.0:1789127385.352535:0:10285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6400/0xeeacf7c024301257 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127385.352540:0:10285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6400/0xeeacf7c024301257 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127385.352556:0:10285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8df7906f6d00) 00010000:00010000:2.0:1789127385.352558:0:10285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789127385.352561:0:10285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6400/0xeeacf7c024301257 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127385.352566:0:10285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6400/0xeeacf7c024301257 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127385.352630:0:10285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6000/0xeeacf7c024301249 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7df8 expref: 55 pid: 10285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127385.352654:0:10285:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7800/0xeeacf7c02430125e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7df8 expref: 54 pid: 10285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127385.352662:0:10285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8df79f06c100) 00010000:00010000:2.0:1789127385.352665:0:10285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789127385.352667:0:10285:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7aeab7800, rc 0) 00000100:00100000:2.0:1789127385.352721:0:10285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6822a03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+54:11789:x1876035733906688:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 703us (870us total) trans 4294967497 rc 0/0 00000100:00100000:2.0:1789127385.352730:0:10285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 205 00000100:00100000:2.0:1789127385.355878:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127385.356144:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733906816 00000100:00100000:1.0:1789127385.356154:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733906816 00000100:00100000:1.0:1789127385.356210:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 206 00000100:00100000:1.0:1789127385.356219:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6827c12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+54:11789:x1876035733906816:12345-192.168.206.40@tcp:54:lfs.0 00010000:00010000:1.0:1789127385.356283:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c02430126c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127385.356299:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c02430126c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127385.356311:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c02430126c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127385.356334:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c02430126c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127385.356341:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c02430126c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127385.356348:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c02430126c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127385.356354:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd96000 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:1.0:1789127385.356358:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c02430126c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127385.356365:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c02430126c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127385.356376:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8df79f06c100) 00010000:00010000:1.0:1789127385.356389:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789127385.356395:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c02430126c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127385.356401:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c02430126c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127385.356485:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6827c12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+54:11789:x1876035733906816:12345-192.168.206.40@tcp:54:lfs.0 Request processed in 266us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127385.356492:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 206 00000100:00100000:1.0:1789127385.358886:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127385.358981:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733907072 00000100:00100000:2.0:1789127385.358990:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733907072 00000100:00100000:2.0:1789127385.359041:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 58 00000100:00100000:2.0:1789127385.359049:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df68265f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+54:11789:x1876035733907072:12345-192.168.206.40@tcp:35:lfs.0 00000100:00100000:2.0:1789127385.359264:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df68265f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+55:11789:x1876035733907072:12345-192.168.206.40@tcp:35:lfs.0 Request processed in 215us (383us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1789127385.359284:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 58 00000100:00100000:0.0:1789127385.419237:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127385.419327:0:12098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733907328 00000100:00100000:3.0:1789127385.419350:0:12098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733907328 00000100:00100000:3.0:1789127385.419456:0:12098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 207 00000100:00100000:3.0:1789127385.419466:0:12098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6822a2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+55:11799:x1876035733907328:12345-192.168.206.40@tcp:101:bash.0 00010000:00010000:3.0:1789127385.419489:0:12098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127385.419492:0:12098:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789127385.419520:0:12098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96400/0xeeacf7c0243011ee lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7ddc expref: 55 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127385.419539:0:12098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8df79f06cd00) 00010000:00010000:3.0:1789127385.419544:0:12098:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789127385.419558:0:12098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173e00/0xeeacf7c024301273 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7dff expref: -99 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127385.419854:0:12098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2172c00/0xeeacf7c02430127a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127385.419868:0:12098:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7800/0xeeacf7c02430125e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7df8 expref: 55 pid: 10285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127385.419876:0:12098:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2172c00/0xeeacf7c02430127a lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127385.419906:0:12098:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7800/0xeeacf7c02430125e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7df8 expref: 55 pid: 10285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127385.419919:0:12098:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7800/0xeeacf7c02430125e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7df8 expref: 55 pid: 10285 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127385.419932:0:12098:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df78efce940 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12098:1876035752771968:192.168.206.40@tcp:104: 00000100:00100000:3.0:1789127385.420026:0:12098:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7a037c480 going to sleep for 11 seconds 00000100:00100000:3.0:1789127385.422784:0:12098:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df78efce940 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12098:1876035752771968:192.168.206.40@tcp:104: 00010000:00010000:3.0:1789127385.422841:0:12098:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2172c00/0xeeacf7c02430127a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127385.423846:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127385.423957:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733907456 00000100:00100000:1.0:1789127385.423963:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733907456 00010000:00010000:1.0:1789127385.424001:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7800/0xeeacf7c02430125e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7df8 expref: 56 pid: 10285 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127385.424034:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 85 00000100:00100000:1.0:1789127385.424043:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6822a1680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+56:2348:x1876035733907456:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789127385.424057:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789127385.424063:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7800/0xeeacf7c02430125e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7df8 expref: 56 pid: 10285 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127385.424075:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7800/0xeeacf7c02430125e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7df8 expref: 56 pid: 10285 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127385.424099:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7800/0xeeacf7c02430125e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7df8 expref: 56 pid: 10285 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127385.424113:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8df79f06c100) 00010000:00010000:1.0:1789127385.424131:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2172c00/0xeeacf7c02430127a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127385.424141:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2172c00/0xeeacf7c02430127a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127385.424149:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2172c00/0xeeacf7c02430127a lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127385.424182:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789127385.424236:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6822a1680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+55:2348:x1876035733907456:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 193us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127385.424244:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 85 00010000:00010000:0.0:1789127385.424424:0:12098:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2172c00/0xeeacf7c02430127a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127385.424432:0:12098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2172c00/0xeeacf7c02430127a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789127385.424459:0:12098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1789127385.424599:0:12098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173e00/0xeeacf7c024301273 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7dff expref: 56 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127385.424614:0:12098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2172c00/0xeeacf7c02430127a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7dff expref: 55 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127385.424621:0:12098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8df79f06c100) 00010000:00010000:0.0:1789127385.424623:0:12098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789127385.424626:0:12098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7c2172c00, rc 0) 00000100:00100000:0.0:1789127385.424677:0:12098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6822a2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+55:11799:x1876035733907328:12345-192.168.206.40@tcp:101:bash.0 Request processed in 5212us (5449us total) trans 4294967499 rc 0/0 00000100:00100000:0.0:1789127385.424685:0:12098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 207 00000100:00100000:0.0:1789127385.428352:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127385.428424:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733907712 00000100:00100000:1.0:1789127385.428446:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733907712 00000100:00100000:1.0:1789127385.428505:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 208 00000100:00100000:1.0:1789127385.428515:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6822a0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+55:11799:x1876035733907712:12345-192.168.206.40@tcp:36:bash.0 00010000:00010000:1.0:1789127385.428851:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024301288 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127385.428869:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024301288 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127385.428880:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024301288 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789127385.428933:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967500 00000004:00010000:1.0:1789127385.428959:0:5832:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000245cbe6c reply state 0000000079d06919 transno 4294967501 ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024301288 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127385.428967:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789127385.429064:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6822a0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+58:11799:x1876035733907712:12345-192.168.206.40@tcp:36:bash.0 Request processed in 550us (719us total) trans 4294967501 rc 0/0 00000100:00100000:1.0:1789127385.429071:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 208 00000020:00080000:1.0:1789127385.429077:0:5832:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789127385.431323:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024301288 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127385.431338:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024301288 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127385.431345:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024301288 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127385.431351:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd96000 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:3.0:1789127385.431356:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024301288 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127385.431363:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024301288 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127385.431378:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8df79f06c100) 00010000:00010000:3.0:1789127385.431381:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127385.431386:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024301288 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127385.431393:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024301288 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127385.432883:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127385.433049:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733907840 00000100:00100000:3.0:1789127385.433059:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733907840 00000100:00100000:3.0:1789127385.433128:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 209 00000100:00100000:3.0:1789127385.433139:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6822a2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+57:11799:x1876035733907840:12345-192.168.206.40@tcp:101:bash.0 00010000:00010000:3.0:1789127385.433162:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127385.433183:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c02430128f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7e06 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127385.433274:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024301296 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127385.433287:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2172c00/0xeeacf7c02430127a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7dff expref: 58 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127385.433295:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024301296 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127385.433327:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2172c00/0xeeacf7c02430127a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7dff expref: 58 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127385.433340:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2172c00/0xeeacf7c02430127a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7dff expref: 58 pid: 12098 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127385.433353:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df78efce940 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5830:1876035752772096:192.168.206.40@tcp:104: 00000100:00100000:3.0:1789127385.433422:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7a037c480 going to sleep for 11 seconds 00000100:00100000:2.0:1789127385.435896:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127385.436001:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df78efce940 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5830:1876035752772096:192.168.206.40@tcp:104: 00010000:00010000:3.0:1789127385.436025:0:5830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024301296 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127385.436121:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733907968 00000100:00100000:0.0:1789127385.436127:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733907968 00010000:00010000:0.0:1789127385.436157:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2172c00/0xeeacf7c02430127a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7dff expref: 59 pid: 12098 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127385.436194:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 86 00000100:00100000:0.0:1789127385.436203:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6827c1e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+59:2349:x1876035733907968:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789127385.436218:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789127385.436225:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2172c00/0xeeacf7c02430127a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7dff expref: 59 pid: 12098 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127385.436255:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2172c00/0xeeacf7c02430127a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7dff expref: 59 pid: 12098 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127385.436288:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2172c00/0xeeacf7c02430127a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7dff expref: 59 pid: 12098 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127385.436306:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8df79f06c100) 00010000:00010000:0.0:1789127385.436311:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024301296 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127385.436320:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024301296 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127385.436328:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024301296 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127385.436529:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789127385.436585:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6827c1e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+58:2349:x1876035733907968:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 382us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127385.436593:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 86 00010000:00010000:1.0:1789127385.437566:0:5830:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024301296 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127385.437782:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024301296 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789127385.437917:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1789127385.437921:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789127385.437941:0:5830:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024301296 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127385.437977:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c02430128f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7e06 expref: 58 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127385.437998:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024301296 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7e06 expref: 57 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127385.438006:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8df79f06c100) 00010000:00010000:1.0:1789127385.438009:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789127385.438012:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df798df1c00, rc 0) 00000100:00100000:1.0:1789127385.438140:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6822a2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+57:11799:x1876035733907840:12345-192.168.206.40@tcp:101:bash.0 Request processed in 5001us (5262us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127385.438148:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 209 00000100:00100000:2.0:1789127385.448322:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127385.448417:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733908224 00000100:00100000:0.0:1789127385.448425:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733908224 00000100:00100000:0.0:1789127385.448571:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 59 00000100:00100000:0.0:1789127385.448591:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6827c1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+57:11799:x1876035733908224:12345-192.168.206.40@tcp:35:bash.0 00000100:00100000:0.0:1789127385.449023:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6827c1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+58:11799:x1876035733908224:12345-192.168.206.40@tcp:35:bash.0 Request processed in 440us (707us total) trans 4294967502 rc 0/0 00000100:00100000:0.0:1789127385.449031:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 59 00000100:00100000:2.0:1789127385.502088:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127385.502176:0:12098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733908352 00000100:00100000:0.0:1789127385.502185:0:12098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733908352 00000100:00100000:0.0:1789127385.502244:0:12098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 210 00000100:00100000:0.0:1789127385.502254:0:12098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6827c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+58:11805:x1876035733908352:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:0.0:1789127385.502279:0:12098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127385.502299:0:12098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729400/0xeeacf7c02430129d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7e0d expref: -99 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127385.502364:0:12098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729800/0xeeacf7c0243012a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127385.502379:0:12098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729800/0xeeacf7c0243012a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127385.502389:0:12098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729800/0xeeacf7c0243012a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789127385.502458:0:12098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:0.0:1789127385.502462:0:12098:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1789127385.502486:0:12098:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729800/0xeeacf7c0243012a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127385.502512:0:12098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729400/0xeeacf7c02430129d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7e0d expref: 60 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127385.502530:0:12098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729800/0xeeacf7c0243012a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7e0d expref: 59 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127385.502539:0:12098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8df79f06cd00) 00010000:00010000:0.0:1789127385.502542:0:12098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789127385.502559:0:12098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7ae729800, rc 0) 00000100:00100000:0.0:1789127385.503559:0:12098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6827c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+59:11805:x1876035733908352:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 1301us (1474us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127385.503569:0:12098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 210 00000100:00100000:3.0:1789127385.508220:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127385.508548:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733908480 00000100:00100000:0.0:1789127385.508558:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733908480 00000100:00100000:0.0:1789127385.510505:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 211 00000100:00100000:0.0:1789127385.510526:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df78efce940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+59:11805:x1876035733908480:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:0.0:1789127385.510546:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127385.510568:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729200/0xeeacf7c0243012ab lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7e14 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127385.510759:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c0243012b2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127385.510773:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c0243012b2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127385.510784:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c0243012b2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127385.511107:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729000/0xeeacf7c0243012b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127385.511115:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729000/0xeeacf7c0243012b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127385.511123:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729000/0xeeacf7c0243012b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127385.511220:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c0243012c0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127385.511242:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c0243012c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127385.511251:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c0243012c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789127385.511285:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1789127385.511289:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789127385.511305:0:5831:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c0243012c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127385.511317:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c0243012c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127385.511326:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c0243012b2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127385.511333:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c0243012b2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127385.511341:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c0243012b2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127385.511348:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7ae729c00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:0.0:1789127385.511352:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c0243012b2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127385.511360:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c0243012b2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127385.511372:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8df79f06cd00) 00010000:00010000:0.0:1789127385.511376:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127385.511386:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c0243012b2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127385.511393:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c0243012b2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127385.511406:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729000/0xeeacf7c0243012b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127385.511413:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729000/0xeeacf7c0243012b9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127385.511419:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729000/0xeeacf7c0243012b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127385.511425:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7ae729000 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:0.0:1789127385.511428:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729000/0xeeacf7c0243012b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127385.511456:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729000/0xeeacf7c0243012b9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127385.511464:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8df782a68800) 00010000:00010000:0.0:1789127385.511467:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127385.511470:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729000/0xeeacf7c0243012b9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127385.511477:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729000/0xeeacf7c0243012b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127385.511510:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729200/0xeeacf7c0243012ab lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7e14 expref: 61 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127385.511535:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c0243012c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7e14 expref: 60 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127385.511542:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8df79f06c100) 00010000:00010000:0.0:1789127385.511544:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789127385.511546:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7ae729e00, rc 0) 00000100:00100000:0.0:1789127385.511700:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df78efce940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+60:11805:x1876035733908480:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 1182us (3488us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127385.511709:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 211 00000100:00100000:2.0:1789127385.518168:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127385.518212:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127385.518285:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733908864 00000100:00100000:0.0:1789127385.518295:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733908864 00000100:00100000:0.0:1789127385.518358:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 15 00000100:00100000:0.0:1789127385.518368:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6827c2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+60:2349:x1876035733908864:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789127385.518385:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789127385.518409:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c0243012c0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7e14 expref: 60 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127385.518427:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8df79f06c100) 00010000:00010000:0.0:1789127385.518447:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789127385.518502:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6827c2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+59:2349:x1876035733908864:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 135us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127385.518509:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 15 00000100:00100000:1.0:1789127385.519109:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733908736 00000100:00100000:1.0:1789127385.519115:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733908736 00000100:00100000:1.0:1789127385.519155:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 212 00000100:00100000:1.0:1789127385.519189:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6827c03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+59:11805:x1876035733908736:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:1.0:1789127385.519206:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127385.519224:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c0243012c7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7e1b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127385.519311:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c0243012ce lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127385.519325:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024301296 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7e06 expref: 60 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127385.519332:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c0243012ce lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127385.519363:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024301296 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7e06 expref: 60 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127385.519376:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024301296 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7e06 expref: 60 pid: 5830 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127385.519390:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df68265cf00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5830:1876035752772224:192.168.206.40@tcp:104: 00000100:00100000:1.0:1789127385.520351:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df785207a80 going to sleep for 11 seconds 00010000:00010000:0.0:1789127385.523612:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127385.527319:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df68265cf00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5830:1876035752772224:192.168.206.40@tcp:104: 00010000:00010000:1.0:1789127385.527347:0:5830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c0243012ce lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127385.530109:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127385.530188:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733908992 00000100:00100000:3.0:1789127385.530197:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733908992 00010000:00010000:3.0:1789127385.530235:0:8454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024301296 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7e06 expref: 61 pid: 5830 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127385.530275:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 87 00000100:00100000:3.0:1789127385.530285:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6827c1680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+61:2349:x1876035733908992:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789127385.530299:0:8454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127385.530306:0:8454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024301296 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7e06 expref: 61 pid: 5830 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127385.530320:0:8454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024301296 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7e06 expref: 61 pid: 5830 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127385.530340:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c024301296 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7e06 expref: 61 pid: 5830 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127385.530355:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8df79f06c100) 00010000:00010000:3.0:1789127385.530360:0:8454:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c0243012ce lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127385.530370:0:8454:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c0243012ce lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127385.530377:0:8454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c0243012ce lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127385.530409:0:8454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127385.530472:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6827c1680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+60:2349:x1876035733908992:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 187us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127385.530494:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 87 00010000:00010000:1.0:1789127385.530616:0:5830:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c0243012ce lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127385.530634:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c0243012ce lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789127385.530663:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1789127385.530846:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c0243012c7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7e1b expref: 61 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127385.530862:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c0243012ce lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7e1b expref: 60 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127385.530870:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8df79f06c100) 00010000:00010000:1.0:1789127385.530873:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789127385.530875:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7bbd96a00, rc 0) 00000100:00100000:1.0:1789127385.530902:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6827c03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+60:11805:x1876035733908736:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 11727us (12744us total) trans 4294967503 rc 0/0 00000100:00100000:1.0:1789127385.530909:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 212 00000100:00100000:2.0:1789127385.534202:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127385.534301:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733909248 00000100:00100000:0.0:1789127385.534310:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733909248 00000100:00100000:0.0:1789127385.534405:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 16 00000100:00100000:0.0:1789127385.534414:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7889cb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+60:11805:x1876035733909248:12345-192.168.206.40@tcp:103:lfs.0 00010000:00010000:0.0:1789127385.534427:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789127385.534449:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2173600/0xeeacf7c02430122d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7df1 expref: 60 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127385.534465:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8df79f06c100) 00010000:00010000:0.0:1789127385.534470:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789127385.534518:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7889cb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+59:11805:x1876035733909248:12345-192.168.206.40@tcp:103:lfs.0 Request processed in 106us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127385.534525:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 16 00000100:00100000:2.0:1789127385.537368:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127385.537522:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733909376 00000100:00100000:1.0:1789127385.537530:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733909376 00000100:00100000:1.0:1789127385.537701:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 213 00000100:00100000:1.0:1789127385.537712:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6827c0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+59:11805:x1876035733909376:12345-192.168.206.40@tcp:58:lfs.0 00010000:00010000:1.0:1789127385.537838:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c0243012dc lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127385.537854:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c0243012dc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127385.537866:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c0243012dc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789127385.538039:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:1.0:1789127385.538114:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6827c0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+59:11805:x1876035733909376:12345-192.168.206.40@tcp:58:lfs.0 Request processed in 403us (752us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127385.538122:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 213 00000100:00100000:2.0:1789127385.540423:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127385.540514:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733909504 00000100:00100000:0.0:1789127385.540522:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733909504 00000100:00100000:0.0:1789127385.540575:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 214 00000100:00100000:0.0:1789127385.540592:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6827c2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+59:11805:x1876035733909504:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:0.0:1789127385.540617:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127385.540649:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729200/0xeeacf7c0243012e3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7e22 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127385.540707:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c0243012dc lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127385.540718:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729200/0xeeacf7c0243012e3 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7e22 expref: 60 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127385.540736:0:5831:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c0243012dc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127385.540765:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729200/0xeeacf7c0243012e3 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7e22 expref: 60 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127385.540777:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8df79f06c100) 00010000:00010000:0.0:1789127385.540781:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789127385.540785:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729200/0xeeacf7c0243012e3 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7e22 expref: 60 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127385.540828:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7ae729200, rc 0) 00000100:00100000:0.0:1789127385.540871:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6827c2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+60:11805:x1876035733909504:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 280us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127385.540879:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 214 00000100:00100000:0.0:1789127385.587131:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789127385.587154:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7af7cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1876035752772352:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789127385.587224:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127385.587507:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752772352 00000100:00100000:3.0:1789127385.587515:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752772352 00000100:00100000:3.0:1789127385.587567:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789127385.587577:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6822a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3301:x1876035752772352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789127385.587598:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 54460416 pending 3407872 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789127385.587676:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6822a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3301:x1876035752772352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127385.587683:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789127385.587867:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7af7cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1876035752772352:0@lo:13:osp-pre-0-0.0 00000001:00080000:2.0:1789127385.666118:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:2.0:1789127385.666142:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000040:00080000:2.0:1789127386.163248:0:12084:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789127386.163261:0:12084:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789127386.163331:0:12084:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:2.0:1789127386.163339:0:12084:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789127386.163523:0:12084:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6827c3840 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12084:1876035752772480:192.168.206.40@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789127386.163667:0:12084:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df791c47780 going to sleep for 11 seconds 00000100:00100000:0.0:1789127386.169409:0:12084:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6827c3840 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12084:1876035752772480:192.168.206.40@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789127386.169495:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127386.170061:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733909632 00000100:00100000:1.0:1789127386.170078:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733909632 00000100:00100000:1.0:1789127386.170133:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 215 00000100:00100000:1.0:1789127386.170143:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6827c0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+60:11806:x1876035733909632:12345-192.168.206.40@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789127386.170172:0:5830:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789127386.170515:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6827c0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+60:11806:x1876035733909632:12345-192.168.206.40@tcp:53:lhsmtool_posix.0 Request processed in 372us (1123us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127386.170523:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 215 00000100:00100000:0.0:1789127386.179030:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127386.179948:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733909760 00000100:00100000:1.0:1789127386.179959:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733909760 00000100:00100000:1.0:1789127386.180017:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 216 00000100:00100000:1.0:1789127386.180026:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6822a21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+60:11806:x1876035733909760:12345-192.168.206.40@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789127386.180089:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c0243012ea lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127386.180104:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c0243012ea lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127386.180118:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c0243012ea lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127386.180188:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96800/0xeeacf7c0243012f1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127386.180196:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96800/0xeeacf7c0243012f1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127386.180202:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96800/0xeeacf7c0243012f1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127386.180222:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c0243012f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127386.180229:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c0243012f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127386.180414:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c0243012f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789127386.180450:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1789127386.180454:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789127386.180476:0:5831:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c0243012f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127386.180487:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c0243012ea lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127386.180493:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c0243012ea lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127386.180500:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c0243012ea lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127386.180515:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd97e00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:1.0:1789127386.180520:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c0243012ea lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127386.180528:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c0243012ea lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127386.180539:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8df79f06c900) 00010000:00010000:1.0:1789127386.180542:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789127386.180546:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c0243012ea lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127386.180551:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c0243012ea lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127386.180565:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96800/0xeeacf7c0243012f1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127386.180571:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96800/0xeeacf7c0243012f1 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127386.180576:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96800/0xeeacf7c0243012f1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127386.180581:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd96800 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:1.0:1789127386.180584:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96800/0xeeacf7c0243012f1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127386.180590:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96800/0xeeacf7c0243012f1 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127386.180608:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff8df782d66600) 00010000:00010000:1.0:1789127386.180611:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789127386.180614:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96800/0xeeacf7c0243012f1 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127386.180620:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96800/0xeeacf7c0243012f1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127386.180643:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c0243012f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127386.180649:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c0243012f8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127386.180655:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c0243012f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127386.180660:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd97800 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:1.0:1789127386.180663:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c0243012f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127386.180668:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c0243012f8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127386.180675:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8df79f06c100) 00010000:00010000:1.0:1789127386.180677:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789127386.180680:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c0243012f8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127386.180685:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c0243012f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127386.180765:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6822a21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+60:11806:x1876035733909760:12345-192.168.206.40@tcp:34:lhsmtool_posix.0 Request processed in 738us (1742us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127386.180773:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 216 00000100:00100000:3.0:1789127386.184256:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127386.184923:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733910016 00000100:00100000:1.0:1789127386.184933:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733910016 00000100:00100000:1.0:1789127386.184993:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 217 00000100:00100000:1.0:1789127386.185004:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7af7cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+60:11806:x1876035733910016:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789127386.185024:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127386.185048:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97a00/0xeeacf7c0243012ff lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7e29 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127386.185138:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96200/0xeeacf7c024301306 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127386.185152:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96200/0xeeacf7c024301306 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127386.185163:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96200/0xeeacf7c024301306 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789127386.185173:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1789127386.185278:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96200/0xeeacf7c024301306 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127386.185286:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96200/0xeeacf7c024301306 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127386.185292:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96200/0xeeacf7c024301306 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127386.185312:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd96200 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:1.0:1789127386.185316:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96200/0xeeacf7c024301306 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127386.185323:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96200/0xeeacf7c024301306 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127386.185334:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8df79f06c100) 00010000:00010000:1.0:1789127386.185338:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789127386.185342:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96200/0xeeacf7c024301306 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127386.185348:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96200/0xeeacf7c024301306 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127386.185389:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97a00/0xeeacf7c0243012ff lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7e29 expref: 62 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127386.185399:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8df79f06c900) 00010000:00010000:1.0:1789127386.185402:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789127386.185405:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97a00/0xeeacf7c0243012ff lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7e29 expref: 62 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127386.185415:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7bbd97a00, rc 0) 00000100:00100000:1.0:1789127386.185478:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7af7cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+61:11806:x1876035733910016:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 Request processed in 476us (1230us total) trans 4294967504 rc 301/301 00000100:00100000:1.0:1789127386.185486:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 217 00000100:00100000:3.0:1789127386.189156:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127386.192410:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733910144 00000100:00100000:1.0:1789127386.192438:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733910144 00000100:00100000:1.0:1789127386.192508:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 218 00000100:00100000:1.0:1789127386.192518:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae043c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+61:11806:x1876035733910144:12345-192.168.206.40@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789127386.192551:0:5830:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789127386.192666:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae043c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+61:11806:x1876035733910144:12345-192.168.206.40@tcp:53:lhsmtool_posix.0 Request processed in 148us (3519us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127386.192673:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 218 00000100:00100000:0.0:1789127386.196373:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127386.198289:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733910400 00000100:00100000:1.0:1789127386.198303:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733910400 00000100:00100000:1.0:1789127386.198377:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 219 00000100:00100000:1.0:1789127386.198387:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6822a1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+61:11806:x1876035733910400:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789127386.198408:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127386.198412:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789127386.198439:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729800/0xeeacf7c0243012a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7e0d expref: 61 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127386.198459:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8df79f06cd00) 00010000:00010000:1.0:1789127386.198463:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789127386.198480:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024301314 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7e30 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789127386.199065:0:5831:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:0.0:1789127386.199276:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728c00/0xeeacf7c02430131b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.199290:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728c00/0xeeacf7c02430131b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.199300:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728c00/0xeeacf7c02430131b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.199362:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024301314 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7e30 expref: 63 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.199378:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728c00/0xeeacf7c02430131b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7e30 expref: 62 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.199385:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8df782a68000) 00010000:00010000:0.0:1789127386.199388:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789127386.199391:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7ae728c00, rc 0) 00000100:00100000:0.0:1789127386.199456:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6822a1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+62:11806:x1876035733910400:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 Request processed in 1070us (3091us total) trans 4294967505 rc 0/0 00000100:00100000:0.0:1789127386.199464:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 219 00000100:00100000:0.0:1789127386.205098:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127386.205163:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733910656 00000100:00100000:1.0:1789127386.205173:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733910656 00000100:00100000:1.0:1789127386.205219:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 220 00000100:00100000:1.0:1789127386.205228:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6822a3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+62:11806:x1876035733910656:12345-192.168.206.40@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789127386.205291:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789127386.205328:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728c00/0xeeacf7c02430131b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7e30 expref: 62 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127386.205346:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8df782a68000) 00010000:00010000:1.0:1789127386.205357:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789127386.205378:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97a00/0xeeacf7c024301329 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127386.205391:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97a00/0xeeacf7c024301329 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127386.205401:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97a00/0xeeacf7c024301329 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127386.205415:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96200/0xeeacf7c024301330 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xa7cda482 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127386.205421:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96200/0xeeacf7c024301330 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xa7cda482 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127386.205427:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96200/0xeeacf7c024301330 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xa7cda482 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127386.205498:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97a00/0xeeacf7c024301329 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127386.205505:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97a00/0xeeacf7c024301329 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127386.205512:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97a00/0xeeacf7c024301329 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127386.205518:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd97a00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:1.0:1789127386.205528:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97a00/0xeeacf7c024301329 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127386.205536:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97a00/0xeeacf7c024301329 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127386.205545:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8df79f06cd00) 00010000:00010000:1.0:1789127386.205548:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789127386.205552:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97a00/0xeeacf7c024301329 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127386.205558:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97a00/0xeeacf7c024301329 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127386.205568:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96200/0xeeacf7c024301330 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xa7cda482 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127386.205574:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96200/0xeeacf7c024301330 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa7cda482 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127386.205580:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96200/0xeeacf7c024301330 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa7cda482 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127386.205586:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd96200 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:1.0:1789127386.205589:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96200/0xeeacf7c024301330 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa7cda482 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127386.205595:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96200/0xeeacf7c024301330 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa7cda482 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127386.205602:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xa7cda482 (ffff8df782d66600) 00010000:00010000:1.0:1789127386.205604:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789127386.205615:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96200/0xeeacf7c024301330 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xa7cda482 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127386.205621:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96200/0xeeacf7c024301330 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xa7cda482 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127386.205712:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6822a3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+61:11806:x1876035733910656:12345-192.168.206.40@tcp:36:lhsmtool_posix.0 Request processed in 484us (624us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789127386.205720:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 220 00000100:00100000:3.0:1789127386.211552:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127386.212915:0:12098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733910784 00000100:00100000:0.0:1789127386.212927:0:12098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733910784 00000100:00100000:0.0:1789127386.212991:0:12098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 221 00000100:00100000:0.0:1789127386.213002:0:12098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae040f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+61:11806:x1876035733910784:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789127386.213021:0:12098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127386.213043:0:12098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728000/0xeeacf7c024301337 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7e37 expref: -99 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.213078:0:12098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728c00/0xeeacf7c02430133e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.213091:0:12098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728c00/0xeeacf7c02430133e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.213119:0:12098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728c00/0xeeacf7c02430133e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.213208:0:12098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728000/0xeeacf7c024301337 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7e37 expref: 63 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.213225:0:12098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728c00/0xeeacf7c02430133e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7e37 expref: 62 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.213233:0:12098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8df782a68800) 00010000:00010000:0.0:1789127386.213249:0:12098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789127386.213253:0:12098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7ae728c00, rc 0) 00000100:00100000:0.0:1789127386.213318:0:12098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae040f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+62:11806:x1876035733910784:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 Request processed in 319us (1777us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127386.213326:0:12098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 221 00000100:00100000:0.0:1789127386.218645:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127386.219025:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733911040 00000100:00100000:2.0:1789127386.219034:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733911040 00000100:00100000:2.0:1789127386.219104:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 222 00000100:00100000:2.0:1789127386.219113:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6822a0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+62:11806:x1876035733911040:12345-192.168.206.40@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789127386.219190:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7000/0xeeacf7c024301345 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127386.219206:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7000/0xeeacf7c024301345 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127386.219230:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7000/0xeeacf7c024301345 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789127386.219456:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:2.0:1789127386.219464:0:5831:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 332375675101ns, next at 333375673141ns, rc = 0 00000004:00010000:2.0:1789127386.219546:0:5831:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000003394b3d5 reply state 000000005940baa6 transno 4294967506 ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7000/0xeeacf7c024301345 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127386.219555:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789127386.219722:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6822a0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+64:11806:x1876035733911040:12345-192.168.206.40@tcp:36:lhsmtool_posix.0 Request processed in 608us (1094us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1789127386.219729:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 222 00010000:00010000:3.0:1789127386.225519:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7000/0xeeacf7c024301345 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127386.225536:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7000/0xeeacf7c024301345 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127386.225544:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7000/0xeeacf7c024301345 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127386.225550:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7aeab7000 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:3.0:1789127386.225554:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7000/0xeeacf7c024301345 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127386.225561:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7000/0xeeacf7c024301345 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127386.225577:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8df782a68800) 00010000:00010000:3.0:1789127386.225592:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789127386.225599:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7000/0xeeacf7c024301345 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127386.225605:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7000/0xeeacf7c024301345 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127386.236599:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127386.236706:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733911168 00000100:00100000:3.0:1789127386.236715:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733911168 00000100:00100000:3.0:1789127386.236772:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 223 00000100:00100000:3.0:1789127386.236820:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6822a2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+63:11806:x1876035733911168:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789127386.236844:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127386.236864:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c02430134c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7e3e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127386.236923:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c02430134c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7e3e expref: 64 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127386.236938:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c02430134c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7e3e expref: 64 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127386.236957:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8df782a68800) 00010000:00010000:3.0:1789127386.236960:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789127386.236964:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df798df1c00, rc 0) 00000100:00100000:3.0:1789127386.237026:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6822a2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+64:11806:x1876035733911168:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 Request processed in 245us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127386.237035:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 223 00000100:00100000:1.0:1789127386.252769:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127386.252942:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733911296 00000100:00100000:3.0:1789127386.252952:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733911296 00000100:00100000:3.0:1789127386.253024:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 62 00000100:00100000:3.0:1789127386.253033:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df68265cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+9:2349:x1876035733911296:12345-192.168.206.40@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1789127386.253501:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df68265cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+10:2349:x1876035733911296:12345-192.168.206.40@tcp:2:lhsmtool_posix.0 Request processed in 467us (740us total) trans 4294967319 rc 0/0 00000100:00100000:3.0:1789127386.253510:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 62 00000100:00100000:2.0:1789127386.263703:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127386.263867:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733911552 00000100:00100000:3.0:1789127386.263876:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733911552 00000100:00100000:3.0:1789127386.263967:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 60 00000100:00100000:3.0:1789127386.263978:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6827c2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+64:11806:x1876035733911552:12345-192.168.206.40@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789127386.264229:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6827c2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+65:11806:x1876035733911552:12345-192.168.206.40@tcp:35:lhsmtool_posix.0 Request processed in 253us (535us total) trans 4294967507 rc 0/0 00000100:00100000:3.0:1789127386.264238:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 60 00000100:00100000:0.0:1789127386.268760:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127386.268953:0:10285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733911808 00000100:00100000:3.0:1789127386.268962:0:10285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733911808 00000100:00100000:3.0:1789127386.269022:0:10285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 224 00000100:00100000:3.0:1789127386.269032:0:10285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6822a30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+65:11806:x1876035733911808:12345-192.168.206.40@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789127386.269170:0:10285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6822a30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+65:11806:x1876035733911808:12345-192.168.206.40@tcp:57:lhsmtool_posix.0 Request processed in 139us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127386.269178:0:10285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 224 00000100:00100000:1.0:1789127386.280908:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127386.281064:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733911936 00000100:00100000:2.0:1789127386.281073:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733911936 00000100:00100000:2.0:1789127386.281130:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 225 00000100:00100000:2.0:1789127386.281140:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df68265e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+65:11806:x1876035733911936:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789127386.281159:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127386.281179:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6e00/0xeeacf7c024301353 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7e45 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127386.281253:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7600/0xeeacf7c02430135a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127386.281269:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7600/0xeeacf7c02430135a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127386.281280:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7600/0xeeacf7c02430135a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789127386.281328:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789127386.281346:0:5831:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7600/0xeeacf7c02430135a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127386.281372:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6e00/0xeeacf7c024301353 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7e45 expref: 67 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127386.281389:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7600/0xeeacf7c02430135a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7e45 expref: 66 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127386.281398:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8df782a68800) 00010000:00010000:2.0:1789127386.281401:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789127386.281404:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7aeab7600, rc 0) 00000100:00100000:2.0:1789127386.281471:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df68265e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+66:11806:x1876035733911936:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 Request processed in 324us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127386.281477:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 225 00000100:00100000:2.0:1789127386.285232:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127386.286189:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733912064 00000100:00100000:0.0:1789127386.286199:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733912064 00000100:00100000:0.0:1789127386.286260:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 63 00000100:00100000:0.0:1789127386.286270:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6827c30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+10:2347:x1876035733912064:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789127386.286288:0:6686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127386.286308:0:6686:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea982a7c/0xeeacf7c024301361 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7e4c expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789127386.286348:0:6686:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa3ead9, blocks: 0x1 00010000:00010000:0.0:1789127386.286369:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=332s v=(0 0) 00010000:00010000:0.0:1789127386.286374:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789127386.286384:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea982a7c/0xeeacf7c024301361 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7e4c expref: 11 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.286404:0:6686:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ea982a7c/0xeeacf7c024301361 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7e4c expref: 11 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.286417:0:6686:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7ae729800, rc 0) 00000100:00100000:0.0:1789127386.286483:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6827c30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+11:2347:x1876035733912064:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 Request processed in 213us (1259us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127386.286491:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 63 00000100:00100000:0.0:1789127386.297240:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127386.297329:0:12098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733912320 00000100:00100000:3.0:1789127386.297338:0:12098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733912320 00000100:00100000:3.0:1789127386.297401:0:12098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 226 00000100:00100000:3.0:1789127386.297411:0:12098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6820bfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+66:11806:x1876035733912320:12345-192.168.206.40@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789127386.297513:0:12098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6820bfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+66:11806:x1876035733912320:12345-192.168.206.40@tcp:57:lhsmtool_posix.0 Request processed in 103us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127386.297531:0:12098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 226 00000100:00100000:1.0:1789127386.301755:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127386.303731:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733912448 00000100:00100000:0.0:1789127386.303743:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733912448 00000100:00100000:0.0:1789127386.303861:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 64 00000100:00100000:0.0:1789127386.303871:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df68265d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+11:11806:x1876035733912448:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789127386.303889:0:6689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127386.303906:0:6689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000120833fb/0xeeacf7c024301368 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7e53 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.304215:0:6689:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ea982a7c/0xeeacf7c024301361 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7e4c expref: 12 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.304240:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789127386.304245:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789127386.304250:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000120833fb/0xeeacf7c024301368 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7e53 expref: 12 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.304282:0:6689:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ea982a7c/0xeeacf7c024301361 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7e4c expref: 12 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.304294:0:6689:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ea982a7c/0xeeacf7c024301361 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7e4c expref: 12 pid: 6686 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127386.304308:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6820bcf00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6689:1876035752772608:192.168.206.40@tcp:104: 00000100:00100000:0.0:1789127386.304406:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7aeaaf6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789127386.308871:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127386.308974:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6820bcf00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6689:1876035752772608:192.168.206.40@tcp:104: 00010000:00010000:3.0:1789127386.309005:0:6689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000120833fb/0xeeacf7c024301368 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7e53 expref: 12 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127386.309025:0:6689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7ae729c00, rc 0) 00000100:00100000:3.0:1789127386.309086:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df68265d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+12:11806:x1876035733912448:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 Request processed in 5216us (7350us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127386.309095:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 64 00000100:00100000:2.0:1789127386.309480:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733912576 00000100:00100000:2.0:1789127386.309487:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733912576 00010000:00010000:2.0:1789127386.309516:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ea982a7c/0xeeacf7c024301361 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7e4c expref: 12 pid: 6686 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127386.309554:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 88 00000100:00100000:2.0:1789127386.309563:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6820bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+12:2348:x1876035733912576:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789127386.309586:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789127386.309607:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ea982a7c/0xeeacf7c024301361 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7e4c expref: 12 pid: 6686 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127386.309643:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ea982a7c/0xeeacf7c024301361 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7e4c expref: 12 pid: 6686 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127386.309667:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea982a7c/0xeeacf7c024301361 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7e4c expref: 12 pid: 6686 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127386.309681:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127386.309685:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127386.309694:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000120833fb/0xeeacf7c024301368 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7e53 expref: 11 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127386.309705:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000120833fb/0xeeacf7c024301368 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7e53 expref: 11 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127386.309739:0:5817:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000120833fb/0xeeacf7c024301368 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7e53 expref: 11 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127386.309752:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6827c3840 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5817:1876035752772736:192.168.206.40@tcp:105: 00000100:00100000:2.0:1789127386.309854:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df791c47840 going to sleep for 11 seconds 00000100:00100000:2.0:1789127386.319985:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6827c3840 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5817:1876035752772736:192.168.206.40@tcp:105: 00010000:00010000:2.0:1789127386.320012:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789127386.320087:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6820bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+11:2348:x1876035733912576:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 10524us (11224us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127386.320098:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 88 00000100:00100000:0.0:1789127386.321007:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127386.328504:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733912704 00000100:00100000:1.0:1789127386.328518:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733912704 00002000:00100000:1.0:1789127386.328576:0:6692:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff8df6820be1c0 x1876035733912704/t0(0) o4->28762f98-a240-4662-a754-e28bbeb6cb4b@192.168.206.40@tcp:122/0 lens 504/0 e 0 to 0 dl 1789127397 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789127386.328587:0:6692:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff8df6820be1c0 with x1876035733912704 ext(0->12) 00002000:00010000:1.0:1789127386.328593:0:6692:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df6820be1c0 00000100:00100000:1.0:1789127386.328643:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 6 00000100:00100000:1.0:1789127386.328653:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6820be1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+11:2347:x1876035733912704:12345-192.168.206.40@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789127386.330282:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6820be1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+13:2347:x1876035733912704:12345-192.168.206.40@tcp:4:lhsmtool_posix.0 Request processed in 1624us (9272us total) trans 4294967320 rc 0/0 00000100:00100000:1.0:1789127386.330294:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 6 00002000:00100000:1.0:1789127386.330304:0:6692:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff8df6820be1c0 x1876035733912704/t4294967320(0) o4->28762f98-a240-4662-a754-e28bbeb6cb4b@192.168.206.40@tcp:122/0 lens 504/448 e 0 to 0 dl 1789127397 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789127386.330313:0:6692:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff8df6820be1c0 with x1876035733912704 ext(0->12) 00002000:00010000:1.0:1789127386.330327:0:6692:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df6820be1c0 00000100:00100000:1.0:1789127386.341320:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127386.341498:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733912832 00000100:00100000:0.0:1789127386.341506:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733912832 00000100:00100000:0.0:1789127386.341570:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 227 00000100:00100000:0.0:1789127386.341580:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df68265de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+66:11806:x1876035733912832:12345-192.168.206.40@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1789127386.413288:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967505 is committed 00000020:00080000:3.0:1789127386.413314:0:5852:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000004:00080000:3.0:1789127386.413353:0:5852:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000001:00080000:3.0:1789127386.413372:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:3.0:1789127386.413376:0:5852:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000020:00080000:3.0:1789127386.413402:0:5852:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8df791c47b40 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1789127386.413408:0:5852:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8df7881f9c00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8df791c476c0 00000020:00080000:3.0:1789127386.413411:0:5852:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8df7881f9d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8df7af614800 00000001:00080000:3.0:1789127386.413422:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967507 is committed 00000020:00080000:3.0:1789127386.413429:0:5852:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8df7a037c6c0 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:3.0:1789127386.413431:0:5852:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8df7a03df700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8df7a037cd80 00000020:00080000:3.0:1789127386.413434:0:5852:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8df788865400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8df7ae972000 00000004:00080000:3.0:1789127386.413451:0:5852:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000100:00100000:3.0:1789127386.413692:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae043480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1876035752772864:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789127386.413758:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127386.414028:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae0421c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752772992:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789127386.414054:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127386.414077:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789127386.414082:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae0412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752773120:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789127386.414100:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127386.414125:0:8063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752772864 00000100:00100000:3.0:1789127386.414131:0:8063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752772864 00000100:00100000:3.0:1789127386.414163:0:8063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752772992 00000100:00100000:3.0:1789127386.414165:0:8063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752772992 00000100:00100000:3.0:1789127386.414181:0:8063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752773120 00000100:00100000:3.0:1789127386.414183:0:8063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752773120 00000100:00100000:3.0:1789127386.414194:0:8063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789127386.414201:0:8063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae041e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1876035752772864:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789127386.414223:0:8063:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:3.0:1789127386.414251:0:8063:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aa3ead8, atime: 0x6aa3ead8, ctime: 0x6aa3ead8, blocks: 0xb 00010000:00010000:3.0:1789127386.414258:0:8063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b830ec46/0xeeacf7c02430136f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127386.414273:0:8063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=332s v=(0 0) 00010000:00010000:3.0:1789127386.414277:0:8063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127386.414284:0:8063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b830ec46/0xeeacf7c02430136f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127386.414300:0:8063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b830ec46/0xeeacf7c02430136f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127386.414311:0:8063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b830ec46/0xeeacf7c02430136f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127386.414330:0:8063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b830ec46/0xeeacf7c02430136f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127386.414345:0:8063:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000020:00080000:1.0:1789127386.415236:0:5863:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:1.0:1789127386.415356:0:5863:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1789127386.416055:0:8063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae041e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3301:x1876035752772864:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1848us (2291us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1789127386.416066:0:8063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789127386.416096:0:8063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789127386.416106:0:8063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae041a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3302:x1876035752772992:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1789127386.416128:0:8063:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:3.0:1789127386.416149:0:8063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd073e3d/0xeeacf7c024301376 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127386.416167:0:8063:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f22728c8/0xeeacf7c024301131 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7db2 expref: 12 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127386.416175:0:8063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1789127386.416179:0:8063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789127386.416183:0:8063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bd073e3d/0xeeacf7c024301376 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127386.416226:0:8063:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f22728c8/0xeeacf7c024301131 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7db2 expref: 12 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127386.416240:0:8063:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f22728c8/0xeeacf7c024301131 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7db2 expref: 12 pid: 8063 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127386.416264:0:8063:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae0403c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8063:1876035752773248:192.168.206.40@tcp:104: 00000100:00100000:3.0:1789127386.416328:0:8063:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7af673d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789127386.416349:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789127386.416357:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae040000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3302:x1876035752773120:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1789127386.416494:0:6686:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1789127386.416498:0:6686:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1789127385 00002000:00010000:3.0:1789127386.416500:0:6686:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789127386.416502:0:6686:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1789127385 -> 1789127385 00002000:00010000:3.0:1789127386.416504:0:6686:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1789127386.416543:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae040000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3302:x1876035752773120:12345-0@lo:2:osp-syn-1-0.0 Request processed in 187us (2442us total) trans 4294967321 rc 0/0 00000100:00100000:3.0:1789127386.416549:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:3.0:1789127386.416576:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789127386.416587:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789127386.416594:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b830ec46/0xeeacf7c02430136f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127386.416614:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df798df0200 already unused, calling callback (ffffffffc17a4550) 00010000:00010000:3.0:1789127386.416618:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b830ec46/0xeeacf7c02430136f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127386.416628:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b830ec46/0xeeacf7c02430136f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127386.416666:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b830ec46/0xeeacf7c02430136f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127386.416673:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b830ec46/0xeeacf7c02430136f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127386.416700:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127386.416701:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127386.416703:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789127386.416738:0:3302:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8df7ae0412c0/2, rc 0, transno 4294967321 00000100:00100000:3.0:1789127386.416744:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae0412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752773120:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789127386.418165:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df68265de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+20:11806:x1876035733912832:12345-192.168.206.40@tcp:44:lhsmtool_posix.0 Request processed in 76580us (76848us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127386.418177:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 227 00000100:00100000:1.0:1789127386.418785:0:3301:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:1.0:1789127386.418979:0:3301:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967309 00000004:00080000:1.0:1789127386.418997:0:3301:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8df7ae058780, transno 4294967307 00000004:00080000:1.0:1789127386.419046:0:3301:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967309 00000100:00100000:1.0:1789127386.419062:0:3301:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8df7ae043480 x1876035752772864/t4294967310(4294967310) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789127402 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1789127386.419073:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8df7ae043480/2, rc 0, transno 4294967310 00000100:00100000:1.0:1789127386.419213:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae043480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1876035752772864:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789127386.420667:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127386.420843:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733912960 00000100:00100000:2.0:1789127386.420850:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733912960 00010000:00010000:2.0:1789127386.420898:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f22728c8/0xeeacf7c024301131 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7db2 expref: 13 pid: 8063 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127386.420929:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 89 00000100:00100000:2.0:1789127386.420939:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df68265da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+13:2348:x1876035733912960:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789127386.420952:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789127386.420957:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f22728c8/0xeeacf7c024301131 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7db2 expref: 13 pid: 8063 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127386.420969:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f22728c8/0xeeacf7c024301131 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7db2 expref: 13 pid: 8063 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127386.420970:0:8063:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae0403c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8063:1876035752773248:192.168.206.40@tcp:104: 00010000:00010000:2.0:1789127386.420990:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f22728c8/0xeeacf7c024301131 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7db2 expref: 13 pid: 8063 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127386.420991:0:8063:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000bd073e3d/0xeeacf7c024301376 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127386.421005:0:5815:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789127386.421010:0:5815:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789127386.421015:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bd073e3d/0xeeacf7c024301376 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127386.421026:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bd073e3d/0xeeacf7c024301376 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127386.421060:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789127386.421125:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df68265da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+12:2348:x1876035733912960:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 187us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127386.421134:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 89 00010000:00010000:3.0:1789127386.421286:0:8063:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000bd073e3d/0xeeacf7c024301376 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127386.421295:0:8063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bd073e3d/0xeeacf7c024301376 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127386.421316:0:8063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd073e3d/0xeeacf7c024301376 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127386.421324:0:8063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bd073e3d/0xeeacf7c024301376 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127386.421675:0:8063:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789127386.421891:0:8511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789127386.421899:0:8511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bd073e3d/0xeeacf7c024301376 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.421907:0:8511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df798df0800 already unused, calling callback (ffffffffc17a4550) 00010000:00010000:0.0:1789127386.421923:0:8511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd073e3d/0xeeacf7c024301376 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.421933:0:8511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd073e3d/0xeeacf7c024301376 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.421946:0:8511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bd073e3d/0xeeacf7c024301376 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.421952:0:8511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bd073e3d/0xeeacf7c024301376 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.421973:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127386.421975:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127386.421977:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127386.423440:0:8063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae041a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3302:x1876035752772992:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7333us (9380us total) trans 4294967322 rc 0/0 00000100:00100000:3.0:1789127386.423453:0:8063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000004:00080000:2.0:1789127386.423540:0:3302:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8df7ae0421c0/2, rc 0, transno 4294967322 00000100:00100000:2.0:1789127386.423547:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae0421c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752772992:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789127386.424285:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127386.424376:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733913088 00000100:00100000:3.0:1789127386.424383:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733913088 00000100:00100000:3.0:1789127386.424433:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 68 00000100:00100000:3.0:1789127386.424442:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df788015850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+12:2348:x1876035733913088:12345-192.168.206.40@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1789127386.458248:0:7646:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967317 is committed 00000001:00080000:1.0:1789127386.458263:0:7646:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967316 is committed 00000001:00080000:1.0:1789127386.458269:0:7646:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000001:00080000:1.0:1789127386.458278:0:7646:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000100:00100000:0.0:1789127386.458403:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df788015850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+7:2348:x1876035733913088:12345-192.168.206.40@tcp:16:lhsmtool_posix.0 Request processed in 33956us (34116us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127386.458415:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 68 00000100:00100000:1.0:1789127386.464297:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127386.464382:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733913344 00000100:00100000:3.0:1789127386.464390:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733913344 00000100:00100000:3.0:1789127386.464451:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 228 00000100:00100000:3.0:1789127386.464461:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df68265c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+20:11806:x1876035733913344:12345-192.168.206.40@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789127386.464510:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127386.464536:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7600/0xeeacf7c02430135a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7e45 expref: 20 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127386.464553:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8df782a68800) 00010000:00010000:3.0:1789127386.464558:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789127386.464596:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c02430137d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127386.464609:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c02430137d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127386.464618:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c02430137d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789127386.465313:0:5830:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000000faf8cbd reply state 00000000a66dfda3 transno 4294967508 ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c02430137d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127386.465325:0:5830:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789127386.465422:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df68265c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+21:11806:x1876035733913344:12345-192.168.206.40@tcp:36:lhsmtool_posix.0 Request processed in 961us (1132us total) trans 4294967508 rc 0/0 00000100:00100000:3.0:1789127386.465431:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 228 00010000:00010000:3.0:1789127386.468655:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c02430137d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127386.468680:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c02430137d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127386.468688:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c02430137d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127386.468694:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df798df0200 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:3.0:1789127386.468699:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c02430137d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127386.468707:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c02430137d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127386.468722:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8df782a68800) 00010000:00010000:3.0:1789127386.468738:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127386.468744:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c02430137d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127386.468750:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c02430137d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127386.469486:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127386.469614:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733913472 00000100:00100000:3.0:1789127386.469623:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733913472 00000100:00100000:3.0:1789127386.469777:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 69 00000100:00100000:3.0:1789127386.469810:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df68265c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+7:2349:x1876035733913472:12345-192.168.206.40@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789127386.470056:0:6689:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1789127386.470060:0:6689:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1789127385 -> 1789127384 00002000:00010000:3.0:1789127386.470062:0:6689:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1789127384 00002000:00010000:3.0:1789127386.470064:0:6689:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1789127385 -> 1789127384 00002000:00010000:3.0:1789127386.470066:0:6689:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1789127386.470245:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df68265c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+8:2349:x1876035733913472:12345-192.168.206.40@tcp:2:lhsmtool_posix.0 Request processed in 459us (764us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1789127386.470254:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 69 00000100:00100000:1.0:1789127386.476085:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127386.476261:0:10285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733913728 00000100:00100000:2.0:1789127386.476271:0:10285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733913728 00000100:00100000:2.0:1789127386.476375:0:10285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 229 00000100:00100000:2.0:1789127386.476385:0:10285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df68265e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+20:11806:x1876035733913728:12345-192.168.206.40@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1789127386.476447:0:10285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7400/0xeeacf7c024301384 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127386.476462:0:10285:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728c00/0xeeacf7c02430133e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7e37 expref: 20 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127386.476471:0:10285:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7400/0xeeacf7c024301384 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127386.476503:0:10285:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728c00/0xeeacf7c02430133e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7e37 expref: 20 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127386.476516:0:10285:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728c00/0xeeacf7c02430133e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7e37 expref: 20 pid: 12098 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127386.476530:0:10285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6827c3840 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10285:1876035752773376:192.168.206.40@tcp:104: 00000100:00100000:2.0:1789127386.476664:0:10285:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7a037c600 going to sleep for 11 seconds 00000100:00100000:2.0:1789127386.484170:0:10285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6827c3840 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10285:1876035752773376:192.168.206.40@tcp:104: 00010000:00010000:2.0:1789127386.484211:0:10285:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7400/0xeeacf7c024301384 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127386.484542:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127386.487040:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733913856 00000100:00100000:3.0:1789127386.487054:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733913856 00010000:00010000:3.0:1789127386.487162:0:8454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728c00/0xeeacf7c02430133e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7e37 expref: 21 pid: 12098 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127386.487259:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 90 00000100:00100000:3.0:1789127386.487270:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df68265d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+21:2349:x1876035733913856:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789127386.487284:0:8454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127386.487290:0:8454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728c00/0xeeacf7c02430133e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7e37 expref: 21 pid: 12098 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127386.487316:0:8454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728c00/0xeeacf7c02430133e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7e37 expref: 21 pid: 12098 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127386.487338:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728c00/0xeeacf7c02430133e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7e37 expref: 21 pid: 12098 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127386.487353:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8df782a68800) 00010000:00010000:3.0:1789127386.487359:0:8454:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7400/0xeeacf7c024301384 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127386.487368:0:8454:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7400/0xeeacf7c024301384 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127386.487376:0:8454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7400/0xeeacf7c024301384 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127386.487411:0:8454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127386.487472:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df68265d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+20:2349:x1876035733913856:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 203us (2931us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127386.487480:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 90 00010000:00010000:0.0:1789127386.487536:0:10285:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7400/0xeeacf7c024301384 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.487544:0:10285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7400/0xeeacf7c024301384 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.487569:0:10285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7400/0xeeacf7c024301384 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.487577:0:10285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7400/0xeeacf7c024301384 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.487594:0:10285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7400/0xeeacf7c024301384 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.487600:0:10285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7aeab7400 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:0.0:1789127386.487605:0:10285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7400/0xeeacf7c024301384 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.487625:0:10285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7400/0xeeacf7c024301384 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.487645:0:10285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8df782a68800) 00010000:00010000:0.0:1789127386.487648:0:10285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1789127386.487652:0:10285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7400/0xeeacf7c024301384 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.487666:0:10285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7400/0xeeacf7c024301384 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127386.487705:0:10285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df68265e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+19:11806:x1876035733913728:12345-192.168.206.40@tcp:55:lhsmtool_posix.0 Request processed in 11322us (11629us total) trans 0 rc -22/-22 00000100:00100000:0.0:1789127386.487713:0:10285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 229 00000100:00100000:1.0:1789127386.494011:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127386.494270:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733913984 00000100:00100000:0.0:1789127386.494280:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733913984 00000100:00100000:0.0:1789127386.494337:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 70 00000100:00100000:0.0:1789127386.494347:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df68265c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+8:2348:x1876035733913984:12345-192.168.206.40@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789127386.494389:0:6688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a0b0659b/0xeeacf7c02430138b lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.494408:0:6688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000120833fb/0xeeacf7c024301368 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7e53 expref: 8 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.494430:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789127386.494434:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789127386.494439:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0b0659b/0xeeacf7c02430138b lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.494472:0:6688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000120833fb/0xeeacf7c024301368 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7e53 expref: 8 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.494487:0:6688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000120833fb/0xeeacf7c024301368 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7e53 expref: 8 pid: 6689 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127386.494500:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6820bd2c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6688:1876035752773504:192.168.206.40@tcp:104: 00000100:00100000:0.0:1789127386.494566:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df786b9c000 going to sleep for 11 seconds 00000100:00100000:1.0:1789127386.500514:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127386.500606:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733914112 00000100:00100000:2.0:1789127386.500627:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733914112 00010000:00010000:2.0:1789127386.500674:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000120833fb/0xeeacf7c024301368 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7e53 expref: 9 pid: 6689 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127386.500719:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 91 00000100:00100000:2.0:1789127386.500728:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df68265e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+9:2349:x1876035733914112:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789127386.500745:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789127386.500764:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000120833fb/0xeeacf7c024301368 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7e53 expref: 9 pid: 6689 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127386.500778:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000120833fb/0xeeacf7c024301368 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7e53 expref: 9 pid: 6689 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127386.500830:0:5815:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789127386.502252:0:5815:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789127386.502261:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a0b0659b/0xeeacf7c02430138b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127386.502274:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0b0659b/0xeeacf7c02430138b lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127386.502397:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127386.502465:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df68265e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+9:2349:x1876035733914112:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 1733us (1954us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127386.502481:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 91 00010000:00010000:0.0:1789127386.502754:0:6688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000120833fb/0xeeacf7c024301368 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7e53 expref: 8 pid: 6689 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127386.502769:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6820bd2c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6688:1876035752773504:192.168.206.40@tcp:104: 00010000:00010000:0.0:1789127386.502822:0:6688:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a0b0659b/0xeeacf7c02430138b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.502949:0:6688:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a0b0659b/0xeeacf7c02430138b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.502958:0:6688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0b0659b/0xeeacf7c02430138b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.502999:0:6688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a0b0659b/0xeeacf7c02430138b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.503006:0:6688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a0b0659b/0xeeacf7c02430138b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.503013:0:6688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a0b0659b/0xeeacf7c02430138b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.503019:0:6688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7ae729a00 already unused, calling callback (ffffffffc17a4550) 00010000:00010000:0.0:1789127386.503023:0:6688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0b0659b/0xeeacf7c02430138b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.503030:0:6688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0b0659b/0xeeacf7c02430138b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.503044:0:6688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a0b0659b/0xeeacf7c02430138b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.503051:0:6688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0b0659b/0xeeacf7c02430138b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127386.503207:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df68265c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+7:2348:x1876035733913984:12345-192.168.206.40@tcp:1:lhsmtool_posix.0 Request processed in 8861us (9206us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127386.503215:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 70 00000100:00100000:1.0:1789127386.506693:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127386.507037:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733914368 00000100:00100000:3.0:1789127386.507047:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733914368 00000100:00100000:3.0:1789127386.507139:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 230 00000100:00100000:3.0:1789127386.507149:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df68265f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+19:11806:x1876035733914368:12345-192.168.206.40@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789127386.507239:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024301392 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127386.507256:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024301392 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127386.507268:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024301392 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127386.507487:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c024301399 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127386.507498:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c02430134c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7e3e expref: 20 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127386.507506:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c024301399 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127386.507535:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c02430134c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7e3e expref: 20 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127386.507547:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c02430134c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7e3e expref: 20 pid: 5830 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127386.507559:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae0403c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1876035752773632:192.168.206.40@tcp:104: 00000100:00100000:3.0:1789127386.507654:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7af673540 going to sleep for 11 seconds 00000100:00100000:1.0:1789127386.512333:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127386.512419:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733914496 00000100:00100000:2.0:1789127386.512428:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733914496 00010000:00010000:2.0:1789127386.512475:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c02430134c lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7e3e expref: 21 pid: 5830 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127386.512513:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 92 00000100:00100000:2.0:1789127386.512522:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df68265cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+21:2349:x1876035733914496:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789127386.512536:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789127386.512544:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c02430134c lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7e3e expref: 21 pid: 5830 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127386.512556:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c02430134c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7e3e expref: 21 pid: 5830 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127386.512575:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8df782a68800) 00010000:00010000:2.0:1789127386.512581:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c024301399 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127386.512591:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c024301399 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127386.512598:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c024301399 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127386.512627:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789127386.512691:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df68265cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+21:2349:x1876035733914496:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 169us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127386.512699:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 92 00010000:00010000:3.0:1789127386.512864:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c02430134c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7e3e expref: 20 pid: 5830 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127386.512891:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae0403c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1876035752773632:192.168.206.40@tcp:104: 00010000:00010000:3.0:1789127386.512917:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c024301399 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127386.512926:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c024301399 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127386.512932:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c024301399 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789127386.513090:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:3.0:1789127386.513226:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:3.0:1789127386.513267:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:3.0:1789127386.513335:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae0403c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5832:1876035752773760:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789127386.513379:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127386.513416:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df791c47780 going to sleep for 11 seconds 00000100:00100000:0.0:1789127386.513520:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752773760 00000100:00100000:0.0:1789127386.513526:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752773760 00000100:00100000:0.0:1789127386.513561:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789127386.513569:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae042940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5832:x1876035752773760:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789127386.513658:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae042940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5832:x1876035752773760:12345-0@lo:1000:mdt00_002.0 Request processed in 88us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127386.513665:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789127386.514067:0:5832:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:2.0:1789127386.514073:0:5832:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967322 00000004:00080000:2.0:1789127386.514088:0:5832:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8df7ae0412c0, transno 4294967321 00000004:00080000:2.0:1789127386.514109:0:5832:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8df7ae0421c0, transno 4294967322 00000100:00100000:2.0:1789127386.514116:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae0403c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5832:1876035752773760:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1789127386.514522:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:2.0:1789127386.514578:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6827c3840 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5832:1876035752773888:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789127386.514627:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127386.514660:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7a037ca80 going to sleep for 11 seconds 00000100:00100000:1.0:1789127386.515404:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752773888 00000100:00100000:1.0:1789127386.515412:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752773888 00000100:00100000:1.0:1789127386.515451:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789127386.515458:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6827c1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5832:x1876035752773888:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789127386.515640:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6827c1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5832:x1876035752773888:12345-0@lo:1000:mdt00_002.0 Request processed in 171us (1001us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1789127386.515648:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789127386.518241:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6827c3840 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5832:1876035752773888:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1789127386.518288:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c024301399 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.518297:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c024301399 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.518304:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c024301399 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.518309:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df798df0800 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:0.0:1789127386.518313:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c024301399 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.518321:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c024301399 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.518335:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8df782a68800) 00010000:00010000:0.0:1789127386.518338:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789127386.518343:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c024301399 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.518348:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0800/0xeeacf7c024301399 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.518400:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c0243012dc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.518407:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c0243012dc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.518412:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c0243012dc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.518418:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd97600 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:0.0:1789127386.518421:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c0243012dc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.518427:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c0243012dc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.518436:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8df79f06c100) 00010000:00010000:0.0:1789127386.518438:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789127386.518444:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729200/0xeeacf7c0243012e3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7e22 expref: 23 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.518455:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729200/0xeeacf7c0243012e3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7e22 expref: 23 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.518463:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729200/0xeeacf7c0243012e3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7e22 expref: 23 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.518496:0:5832:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729200/0xeeacf7c0243012e3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7e22 expref: 23 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127386.518521:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6820bd2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1876035752774016:192.168.206.40@tcp:105: 00000100:00100000:0.0:1789127386.518617:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df786b9c000 going to sleep for 11 seconds 00000100:00100000:1.0:1789127386.523302:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127386.523403:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6820bd2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1876035752774016:192.168.206.40@tcp:105: 00010000:00010000:0.0:1789127386.523431:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c0243012dc lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.523441:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97600/0xeeacf7c0243012dc lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.523475:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729a00/0xeeacf7c0243013a0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.523487:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729a00/0xeeacf7c0243013a0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.523498:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729a00/0xeeacf7c0243013a0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.523507:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729a00/0xeeacf7c0243013a0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.523513:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729a00/0xeeacf7c0243013a0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.523521:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729a00/0xeeacf7c0243013a0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.523527:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7ae729a00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:0.0:1789127386.523531:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729a00/0xeeacf7c0243013a0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.523552:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729a00/0xeeacf7c0243013a0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.523565:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8df79f06c100) 00010000:00010000:0.0:1789127386.523568:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127386.523572:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729a00/0xeeacf7c0243013a0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.523590:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729a00/0xeeacf7c0243013a0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.523607:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024301392 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.523614:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024301392 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.523621:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024301392 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.523626:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df798df0200 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:0.0:1789127386.523639:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024301392 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.523646:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024301392 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.523654:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8df79f06c100) 00010000:00010000:0.0:1789127386.523664:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789127386.523668:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024301392 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.523683:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0200/0xeeacf7c024301392 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127386.524195:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df68265f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+23:11806:x1876035733914368:12345-192.168.206.40@tcp:57:lhsmtool_posix.0 Request processed in 17045us (17506us total) trans 4294967513 rc 0/0 00000100:00100000:0.0:1789127386.524206:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 230 00000020:00080000:0.0:1789127386.524212:0:5832:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1789127386.524294:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733914624 00000100:00100000:3.0:1789127386.524300:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733914624 00000100:00100000:3.0:1789127386.524343:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 61 00000100:00100000:3.0:1789127386.524352:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df68265d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+23:11805:x1876035733914624:12345-192.168.206.40@tcp:49:lfs.0 00000100:00100000:3.0:1789127386.524446:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df68265d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+23:11805:x1876035733914624:12345-192.168.206.40@tcp:49:lfs.0 Request processed in 95us (1153us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127386.524453:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 61 00000100:00100000:1.0:1789127386.529165:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127386.529273:0:12098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733914880 00000100:00100000:0.0:1789127386.529283:0:12098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733914880 00000100:00100000:0.0:1789127386.529334:0:12098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 231 00000100:00100000:0.0:1789127386.529344:0:12098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df68265cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+23:11805:x1876035733914880:12345-192.168.206.40@tcp:58:lfs.0 00000040:00080000:0.0:1789127386.529730:0:12098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:0.0:1789127386.530723:0:12098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df68265cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+23:11805:x1876035733914880:12345-192.168.206.40@tcp:58:lfs.0 Request processed in 1372us (1558us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127386.530735:0:12098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 231 00000040:00080000:2.0:1789127386.533262:0:12084:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789127386.533271:0:12084:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789127386.533333:0:12084:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1789127386.533340:0:12084:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789127386.533462:0:12084:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6827c2940 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12084:1876035752774144:192.168.206.40@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789127386.533731:0:12084:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7a037c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789127386.535293:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127386.535420:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733915136 00000100:00100000:3.0:1789127386.535429:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733915136 00000100:00100000:3.0:1789127386.535484:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 62 00000100:00100000:3.0:1789127386.535494:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df791569c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+24:11806:x1876035733915136:12345-192.168.206.40@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789127386.536519:0:5833:0:(mdd_object.c:4024:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789127386.536991:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967514 00010000:00010000:3.0:1789127386.537052:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c0243013a7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127386.537069:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c0243013a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127386.537080:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c0243013a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127386.537088:0:5833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c0243013a7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127386.537095:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c0243013a7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127386.537101:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c0243013a7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127386.537178:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789127386.537261:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df791569c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+26:11806:x1876035733915136:12345-192.168.206.40@tcp:35:lhsmtool_posix.0 Request processed in 1767us (1973us total) trans 4294967515 rc 0/0 00000100:00100000:3.0:1789127386.537271:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 62 00000020:00080000:3.0:1789127386.537277:0:5833:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789127386.538494:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789127386.538504:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c0243013a7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.538514:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df798df1c00 already unused, calling callback (ffffffffc17a4550) 00010000:00010000:0.0:1789127386.538517:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c0243013a7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.538527:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c0243013a7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.538539:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8df79f06ce00) 00010000:00010000:0.0:1789127386.538542:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789127386.538558:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c0243013a7 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.538565:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1c00/0xeeacf7c0243013a7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.539124:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127386.539127:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127386.539130:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127386.545184:0:12084:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6827c2940 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12084:1876035752774144:192.168.206.40@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789127386.546548:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127386.546622:0:10285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733915264 00000100:00100000:0.0:1789127386.546638:0:10285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733915264 00000100:00100000:0.0:1789127386.546692:0:10285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 232 00000100:00100000:0.0:1789127386.546701:0:10285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6827c2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+25:11807:x1876035733915264:12345-192.168.206.40@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789127386.546729:0:10285:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789127386.546988:0:10285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6827c2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+25:11807:x1876035733915264:12345-192.168.206.40@tcp:53:lhsmtool_posix.0 Request processed in 287us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127386.546996:0:10285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 232 00010000:00010000:3.0:1789127386.547494:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127386.553466:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127386.553559:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733915520 00000100:00100000:0.0:1789127386.553569:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733915520 00000100:00100000:0.0:1789127386.553625:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 233 00000100:00100000:0.0:1789127386.553644:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df68265fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+25:11807:x1876035733915520:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789127386.553668:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127386.553689:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729a00/0xeeacf7c0243013ae lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7e5a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.553775:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c0243013b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.553824:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c0243013b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.553848:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c0243013b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789127386.553860:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1789127386.553985:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729a00/0xeeacf7c0243013ae lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7e5a expref: 28 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.554001:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c0243013b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7e5a expref: 27 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.554009:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8df79f06c100) 00010000:00010000:0.0:1789127386.554012:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789127386.554015:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7ae729c00, rc 0) 00000100:00100000:0.0:1789127386.554060:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df68265fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+27:11807:x1876035733915520:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 Request processed in 418us (602us total) trans 4294967516 rc 0/0 00000100:00100000:0.0:1789127386.554067:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 233 00000100:00100000:3.0:1789127386.569696:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127386.569830:0:12098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733915648 00000100:00100000:0.0:1789127386.569840:0:12098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733915648 00000100:00100000:0.0:1789127386.569900:0:12098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 234 00000100:00100000:0.0:1789127386.569909:0:12098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae041680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+27:11809:x1876035733915648:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:0.0:1789127386.569928:0:12098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127386.569948:0:12098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729a00/0xeeacf7c0243013c3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7e61 expref: -99 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.570010:0:12098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728a00/0xeeacf7c0243013ca lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.570041:0:12098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728a00/0xeeacf7c0243013ca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.570053:0:12098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728a00/0xeeacf7c0243013ca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.570069:0:12098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728400/0xeeacf7c0243013d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.570077:0:12098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728400/0xeeacf7c0243013d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.570083:0:12098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728400/0xeeacf7c0243013d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.570370:0:12098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c0243013d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.570382:0:12098:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c0243012ce lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7e1b expref: 28 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.570390:0:12098:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c0243013d8 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.570420:0:12098:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c0243012ce lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7e1b expref: 28 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.570435:0:12098:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c0243012ce lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7e1b expref: 28 pid: 5830 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127386.570461:0:12098:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6820bd2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12098:1876035752774272:192.168.206.40@tcp:104: 00000100:00100000:0.0:1789127386.570547:0:12098:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df782cb8840 going to sleep for 11 seconds 00000100:00100000:2.0:1789127386.574025:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127386.574119:0:10285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733915904 00000100:00100000:0.0:1789127386.574127:0:10285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733915904 00000100:00100000:0.0:1789127386.574214:0:10285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 235 00000100:00100000:0.0:1789127386.574225:0:10285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6827c1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+29:11807:x1876035733915904:12345-192.168.206.40@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789127386.574295:0:10285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729000/0xeeacf7c0243013df lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.574311:0:10285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729000/0xeeacf7c0243013df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.574322:0:10285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729000/0xeeacf7c0243013df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.574509:0:10285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729000/0xeeacf7c0243013df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.574517:0:10285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729000/0xeeacf7c0243013df lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.574523:0:10285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729000/0xeeacf7c0243013df lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.574530:0:10285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7ae729000 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:0.0:1789127386.574534:0:10285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729000/0xeeacf7c0243013df lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.574541:0:10285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729000/0xeeacf7c0243013df lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.574563:0:10285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8df79f06c100) 00010000:00010000:0.0:1789127386.574566:0:10285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789127386.574570:0:10285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729000/0xeeacf7c0243013df lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.574588:0:10285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729000/0xeeacf7c0243013df lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10285 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127386.574743:0:10285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6827c1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+30:11807:x1876035733915904:12345-192.168.206.40@tcp:57:lhsmtool_posix.0 Request processed in 519us (723us total) trans 4294967517 rc 0/0 00000100:00100000:0.0:1789127386.574751:0:10285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 235 00000040:00080000:3.0:1789127386.574903:0:12084:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789127386.574908:0:12084:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789127386.575401:0:12084:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1789127386.575409:0:12084:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789127386.579093:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127386.579462:0:12098:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6820bd2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12098:1876035752774272:192.168.206.40@tcp:104: 00010000:00010000:0.0:1789127386.579487:0:12098:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c0243013d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127386.579764:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733916416 00000100:00100000:1.0:1789127386.579772:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733916416 00000100:00100000:1.0:1789127386.579847:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 63 00000100:00100000:1.0:1789127386.579856:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae040780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+30:11807:x1876035733916416:12345-192.168.206.40@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789127386.580066:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae040780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+31:11807:x1876035733916416:12345-192.168.206.40@tcp:35:lhsmtool_posix.0 Request processed in 210us (981us total) trans 4294967518 rc 0/0 00000100:00100000:1.0:1789127386.580074:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 63 00000100:00100000:1.0:1789127386.581945:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127386.583132:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733916160 00000100:00100000:0.0:1789127386.583143:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733916160 00000100:00100000:0.0:1789127386.583201:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 64 00000100:00100000:0.0:1789127386.583210:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df68265f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+31:5587:x1876035733916160:12345-192.168.206.40@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789127386.583406:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df68265f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+32:5587:x1876035733916160:12345-192.168.206.40@tcp:35:ldlm_bl.0 Request processed in 196us (1467us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1789127386.583414:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 64 00000100:00100000:0.0:1789127386.585521:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127386.585733:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733916544 00000100:00100000:1.0:1789127386.585741:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733916544 00010000:00010000:1.0:1789127386.585778:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c0243012ce lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7e1b expref: 32 pid: 5830 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127386.585851:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 93 00000100:00100000:1.0:1789127386.585860:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6820bd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+32:2349:x1876035733916544:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789127386.586007:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789127386.586016:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c0243012ce lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7e1b expref: 32 pid: 5830 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127386.586044:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c0243012ce lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7e1b expref: 32 pid: 5830 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127386.586068:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c0243012ce lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7e1b expref: 32 pid: 5830 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127386.586083:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8df79f06c100) 00010000:00010000:1.0:1789127386.586089:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c0243013d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127386.586098:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c0243013d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127386.586107:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c0243013d8 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127386.586137:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789127386.586227:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6820bd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+31:2349:x1876035733916544:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 367us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127386.586234:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 93 00010000:00010000:0.0:1789127386.586291:0:12098:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c0243013d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.586300:0:12098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c0243013d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789127386.586343:0:12098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1789127386.586348:0:12098:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789127386.586365:0:12098:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c0243013d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.586377:0:12098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c0243013d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.586386:0:12098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728a00/0xeeacf7c0243013ca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.586392:0:12098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728a00/0xeeacf7c0243013ca lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.586399:0:12098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728a00/0xeeacf7c0243013ca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.586405:0:12098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7ae728a00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:0.0:1789127386.586410:0:12098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728a00/0xeeacf7c0243013ca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.586418:0:12098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728a00/0xeeacf7c0243013ca lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.586428:0:12098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8df79f06cd00) 00010000:00010000:0.0:1789127386.586441:0:12098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127386.586445:0:12098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728a00/0xeeacf7c0243013ca lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.586452:0:12098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728a00/0xeeacf7c0243013ca lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.586474:0:12098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728400/0xeeacf7c0243013d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.586480:0:12098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728400/0xeeacf7c0243013d1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.586487:0:12098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728400/0xeeacf7c0243013d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.586493:0:12098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7ae728400 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:0.0:1789127386.586496:0:12098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728400/0xeeacf7c0243013d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.586502:0:12098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728400/0xeeacf7c0243013d1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.586510:0:12098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8df782a68800) 00010000:00010000:0.0:1789127386.586513:0:12098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127386.586516:0:12098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728400/0xeeacf7c0243013d1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.586522:0:12098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728400/0xeeacf7c0243013d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.586553:0:12098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729a00/0xeeacf7c0243013c3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7e61 expref: 31 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.586565:0:12098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c0243013d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7e61 expref: 30 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127386.586583:0:12098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8df79f06c100) 00010000:00010000:0.0:1789127386.586586:0:12098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789127386.586588:0:12098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7ae729e00, rc 0) 00000100:00100000:0.0:1789127386.586626:0:12098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae041680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+30:11809:x1876035733915648:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 16718us (16938us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127386.586643:0:12098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 234 00000040:00080000:3.0:1789127387.313278:0:12965:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789127387.313286:0:12965:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789127387.313381:0:12965:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1789127387.313386:0:12965:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789127387.456680:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127387.456914:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733916800 00000100:00100000:1.0:1789127387.456923:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733916800 00000100:00100000:1.0:1789127387.456987:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 236 00000100:00100000:1.0:1789127387.456997:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6827c1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+30:11833:x1876035733916800:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:1.0:1789127387.457020:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127387.457040:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c0243013e6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7e68 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127387.457142:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97a00/0xeeacf7c0243013ed lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127387.457156:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97a00/0xeeacf7c0243013ed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127387.457168:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97a00/0xeeacf7c0243013ed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789127387.457178:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000100:00080000:0.0:1789127387.457263:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789127387.457284:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c0243013e6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7e68 expref: 33 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127387.457300:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97a00/0xeeacf7c0243013ed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7e68 expref: 32 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127387.457308:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8df79f06c100) 00010000:00010000:1.0:1789127387.457311:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789127387.457314:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7bbd97a00, rc 0) 00000100:00100000:1.0:1789127387.457373:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6827c1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+32:11833:x1876035733916800:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 378us (702us total) trans 4294967520 rc 0/0 00000100:00100000:1.0:1789127387.457380:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 236 00000100:00100000:0.0:1789127387.464032:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127387.466706:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733916928 00000100:00100000:2.0:1789127387.466719:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733916928 00000100:00100000:2.0:1789127387.466810:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 237 00000100:00100000:2.0:1789127387.466822:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6820bde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+32:11833:x1876035733916928:12345-192.168.206.40@tcp:54:lfs.0 00010000:00010000:2.0:1789127387.466889:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7400/0xeeacf7c0243013fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127387.466906:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7400/0xeeacf7c0243013fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127387.466916:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7400/0xeeacf7c0243013fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127387.466955:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7400/0xeeacf7c0243013fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127387.466961:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7400/0xeeacf7c0243013fb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127387.466968:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7400/0xeeacf7c0243013fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127387.466973:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7aeab7400 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:2.0:1789127387.466978:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7400/0xeeacf7c0243013fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127387.466985:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7400/0xeeacf7c0243013fb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127387.466995:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8df79f06c100) 00010000:00010000:2.0:1789127387.466998:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789127387.467003:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7400/0xeeacf7c0243013fb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127387.467009:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7400/0xeeacf7c0243013fb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127387.467095:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6820bde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+32:11833:x1876035733916928:12345-192.168.206.40@tcp:54:lfs.0 Request processed in 275us (3071us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127387.467104:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 237 00010000:00010000:0.0:1789127387.571229:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127387.597740:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127387.597935:0:8063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733917056 00000100:00100000:3.0:1789127387.597946:0:8063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733917056 00000100:00100000:3.0:1789127387.598023:0:8063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 71 00000100:00100000:3.0:1789127387.598033:0:8063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6820bda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+7:2349:x1876035733917056:12345-192.168.206.40@tcp:101:cat.0 00010000:00010000:3.0:1789127387.598049:0:8063:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127387.598070:0:8063:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b830ec46/0xeeacf7c024301402 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7e6f expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789127387.598097:0:8063:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6aa3ead8, atime: 0x6aa3ead8, ctime: 0x6aa3ead8, blocks: 0xb 00010000:00010000:3.0:1789127387.598116:0:8063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=333s v=(0 0) 00010000:00010000:3.0:1789127387.598121:0:8063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127387.598130:0:8063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b830ec46/0xeeacf7c024301402 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7e6f expref: 8 pid: 8063 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127387.598145:0:8063:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b830ec46/0xeeacf7c024301402 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7e6f expref: 8 pid: 8063 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127387.598158:0:8063:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df798df0200, rc 0) 00000100:00080000:0.0:1789127387.598299:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789127387.598682:0:8063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6820bda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+8:2349:x1876035733917056:12345-192.168.206.40@tcp:101:cat.0 Request processed in 649us (949us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127387.598689:0:8063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 71 00000100:00100000:0.0:1789127387.604706:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127387.605044:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733917184 00000100:00100000:3.0:1789127387.605054:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733917184 00002000:00100000:3.0:1789127387.605103:0:6694:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff8df6820bc000 x1876035733917184/t0(0) o3->28762f98-a240-4662-a754-e28bbeb6cb4b@192.168.206.40@tcp:123/0 lens 488/0 e 0 to 0 dl 1789127398 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789127387.605131:0:6694:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff8df6820bc000 with x1876035733917184 ext(0->4095) 00002000:00010000:3.0:1789127387.605137:0:6694:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df6820bc000 00000100:00100000:3.0:1789127387.605216:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 7 00000100:00100000:3.0:1789127387.605227:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6820bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+8:2347:x1876035733917184:12345-192.168.206.40@tcp:3:cat.0 00000100:00100000:3.0:1789127387.605460:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6820bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+8:2347:x1876035733917184:12345-192.168.206.40@tcp:3:cat.0 Request processed in 234us (761us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789127387.605468:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 7 00002000:00100000:3.0:1789127387.605475:0:6694:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff8df6820bc000 x1876035733917184/t0(0) o3->28762f98-a240-4662-a754-e28bbeb6cb4b@192.168.206.40@tcp:123/0 lens 488/4536 e 0 to 0 dl 1789127398 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789127387.605483:0:6694:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff8df6820bc000 with x1876035733917184 ext(0->4095) 00002000:00010000:3.0:1789127387.605486:0:6694:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df6820bc000 00010000:00010000:0.0:1789127388.597051:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127389.630373:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127389.683658:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6820bc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3300:1876035752774400:0@lo:400:kworker.0 00000100:00100000:2.0:1789127389.683744:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127389.683838:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6820be580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1876035752774912:0@lo:400:kworker.0 00000100:00100000:2.0:1789127389.683870:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127389.683892:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789127389.683898:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6820be940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876035752774528:0@lo:400:kworker.0 00000100:00100000:2.0:1789127389.683919:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127389.683934:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6820bf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1876035752775040:0@lo:400:kworker.0 00000100:00100000:2.0:1789127389.683955:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127389.683981:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6820bd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1876035752774656:0@lo:400:kworker.0 00000100:00100000:2.0:1789127389.684005:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127389.684023:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789127389.684028:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6820bc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752774784:0@lo:400:kworker.0 00000100:00100000:2.0:1789127389.684050:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127389.684075:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752774912 00000100:00100000:2.0:1789127389.684081:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752774912 00000100:00100000:2.0:1789127389.684122:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752774528 00000100:00100000:2.0:1789127389.684125:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752774528 00000100:00100000:2.0:1789127389.684143:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752774656 00000100:00100000:2.0:1789127389.684145:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752774656 00000100:00100000:2.0:1789127389.684162:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789127389.684169:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6827c2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876035752774912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127389.684216:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6827c2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876035752774912:12345-0@lo:400:kworker.0 Request processed in 47us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127389.684223:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789127389.684238:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1789127389.684244:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6827c3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876035752774528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127389.684271:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6827c3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876035752774528:12345-0@lo:400:kworker.0 Request processed in 27us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127389.684285:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1789127389.684316:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789127389.684402:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789127389.684411:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae040b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1876035752775168:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789127389.684438:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127389.684463:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752775040 00000100:00100000:3.0:1789127389.684466:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752775040 00000100:00100000:3.0:1789127389.684497:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752774784 00000100:00100000:3.0:1789127389.684500:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752774784 00000100:00100000:3.0:1789127389.684519:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789127389.684526:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6827c0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3300:x1876035752775040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127389.684558:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6827c0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3300:x1876035752775040:12345-0@lo:400:kworker.0 Request processed in 33us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127389.684564:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789127389.684582:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789127389.684588:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bfc49680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3302:x1876035752774784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127389.684631:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bfc49680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3302:x1876035752774784:12345-0@lo:400:kworker.0 Request processed in 43us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127389.684638:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789127389.684662:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752775168 00000100:00100000:3.0:1789127389.684665:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752775168 00000100:00100000:3.0:1789127389.684684:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789127389.684689:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae042d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1876035752775168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789127389.684715:0:10333:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789127389.684748:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae042d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1876035752775168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127389.684754:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789127389.684815:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae040b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1876035752775168:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789127389.684845:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6820bc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752774784:0@lo:400:kworker.0 00000100:00100000:3.0:1789127389.684888:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6820be940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876035752774528:0@lo:400:kworker.0 00000100:00100000:3.0:1789127389.684898:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6820bf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1876035752775040:0@lo:400:kworker.0 00000100:00100000:3.0:1789127389.684907:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6820be580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1876035752774912:0@lo:400:kworker.0 00000100:00100000:2.0:1789127389.685135:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6827c30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876035752774656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127389.685175:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6827c30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876035752774656:12345-0@lo:400:kworker.0 Request processed in 853us (1169us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127389.685231:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6820bd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1876035752774656:0@lo:400:kworker.0 00000100:00100000:0.0:1789127389.685314:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752774400 00000100:00100000:0.0:1789127389.685319:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752774400 00000100:00100000:0.0:1789127389.685357:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1789127389.685364:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df787bb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:3300:x1876035752774400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127389.685403:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df787bb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:3300:x1876035752774400:12345-0@lo:400:kworker.0 Request processed in 39us (1658us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127389.685409:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00080000:0.0:1789127389.685441:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789127389.685445:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789127389.685448:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789127389.689881:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6820bc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3300:1876035752774400:0@lo:400:kworker.0 00000100:00100000:2.0:1789127389.703379:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1789127390.442874:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127390.442908:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127390.442980:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127390.443003:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127390.443035:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127390.443062:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733917568 00000100:00100000:0.0:1789127390.443070:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733917568 00000100:00100000:0.0:1789127390.443118:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733917696 00000100:00100000:0.0:1789127390.443121:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733917696 00000100:00100000:0.0:1789127390.443141:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 84 00000100:00100000:0.0:1789127390.443150:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6820bcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+5:2348:x1876035733917568:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:0.0:1789127390.443211:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6820bcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+5:2348:x1876035733917568:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 61us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127390.443218:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 84 00000100:00100000:0.0:1789127390.443235:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 85 00000100:00100000:0.0:1789127390.443240:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6820bc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+8:2348:x1876035733917696:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:0.0:1789127390.443263:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6820bc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+8:2348:x1876035733917696:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 22us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127390.443268:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 85 00000100:00100000:0.0:1789127390.443285:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733917824 00000100:00100000:0.0:1789127390.443288:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733917824 00000100:00100000:0.0:1789127390.443310:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733917440 00000100:00100000:0.0:1789127390.443313:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733917440 00000100:00100000:0.0:1789127390.443333:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 165 00000100:00100000:0.0:1789127390.443339:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6820bed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81b0e267-d7e0-4043-b34e-eec2dc4c5a6b+5:2348:x1876035733917824:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:0.0:1789127390.443366:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6820bed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81b0e267-d7e0-4043-b34e-eec2dc4c5a6b+5:2348:x1876035733917824:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 27us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127390.443371:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 165 00000100:00100000:0.0:1789127390.443383:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 166 00000100:00100000:0.0:1789127390.443388:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6820bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+32:2348:x1876035733917440:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:0.0:1789127390.443418:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6820bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28762f98-a240-4662-a754-e28bbeb6cb4b+32:2348:x1876035733917440:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 30us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127390.443424:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 166 00000100:00080000:0.0:1789127390.443447:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789127390.443451:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789127390.443453:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789127390.443594:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733917312 00000100:00100000:2.0:1789127390.443599:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733917312 00000100:00100000:2.0:1789127390.443641:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 329 00000100:00100000:2.0:1789127390.443648:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df788035050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d829a69b-d740-4e4c-8301-ef09c9d45165+13:2348:x1876035733917312:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:2.0:1789127390.443677:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df788035050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d829a69b-d740-4e4c-8301-ef09c9d45165+13:2348:x1876035733917312:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 31us (814us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127390.443684:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 329 00010000:00010000:3.0:1789127390.646161:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127390.708755:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789127390.708775:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae040b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752775296:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789127390.708872:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127390.708939:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752775296 00000100:00100000:3.0:1789127390.708946:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752775296 00000100:00100000:3.0:1789127390.708990:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789127390.708999:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae0430c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1876035752775296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789127390.709031:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789127390.709074:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae0430c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1876035752775296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127390.709081:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789127390.709126:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae040b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752775296:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1789127390.764329:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00010000:00010000:1.0:1789127391.668141:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789127391.789118:0:7646:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:1.0:1789127391.789134:0:7646:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000001:00080000:3.0:1789127391.827715:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000001:00080000:3.0:1789127391.827742:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:3.0:1789127391.827749:0:5852:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:3.0:1789127391.827766:0:5852:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8df7a037c000 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1789127391.827771:0:5852:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8df7881f9800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8df7a037c600 00000020:00080000:3.0:1789127391.827774:0:5852:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8df7881f9400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8df682bf1c00 00000020:00080000:3.0:1789127391.827844:0:5863:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:3.0:1789127391.828012:0:5863:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:0.0:1789127392.385782:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127392.389287:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733917952 00000100:00100000:2.0:1789127392.389301:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733917952 00000100:00100000:0.0:1789127392.394334:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 238 00000100:00100000:0.0:1789127392.394349:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6820bd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+19:11494:x1876035733917952:12345-192.168.206.40@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1789127392.394515:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6820bd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+19:11494:x1876035733917952:12345-192.168.206.40@tcp:60:lhsmtool_posix.0 Request processed in 170us (8741us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127392.394524:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 238 00000100:00080000:2.0:1789127392.397346:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789127392.402144:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127392.402256:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733918208 00000100:00100000:0.0:1789127392.402265:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733918208 00000100:00100000:0.0:1789127392.402350:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 65 00000100:00100000:0.0:1789127392.402360:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae042580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+19:11494:x1876035733918208:12345-192.168.206.40@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789127392.403091:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae042580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+20:11494:x1876035733918208:12345-192.168.206.40@tcp:35:lhsmtool_posix.0 Request processed in 730us (955us total) trans 4294967521 rc 0/0 00000100:00100000:0.0:1789127392.403101:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 65 00000100:00100000:1.0:1789127392.671481:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127392.671576:0:12098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733918336 00000100:00100000:0.0:1789127392.671584:0:12098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733918336 00000100:00100000:0.0:1789127392.671706:0:12098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 239 00000100:00100000:0.0:1789127392.671717:0:12098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df68265d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81b0e267-d7e0-4043-b34e-eec2dc4c5a6b+5:12285:x1876035733918336:12345-192.168.206.40@tcp:101:lsof.0 00010000:00010000:0.0:1789127392.671739:0:12098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127392.671830:0:12098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729000/0xeeacf7c024301409 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7e76 expref: -99 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127392.671907:0:12098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728000/0xeeacf7c024301410 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127392.671922:0:12098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728000/0xeeacf7c024301410 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127392.671936:0:12098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728000/0xeeacf7c024301410 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789127392.672115:0:12098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1789127392.672120:0:12098:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1789127392.672205:0:12098:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728000/0xeeacf7c024301410 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127392.672232:0:12098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729000/0xeeacf7c024301409 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7e76 expref: 7 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127392.672249:0:12098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728000/0xeeacf7c024301410 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7e76 expref: 6 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127392.672258:0:12098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df782a68a00) 00010000:00010000:0.0:1789127392.672261:0:12098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789127392.672264:0:12098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7ae728000, rc 0) 00000100:00100000:0.0:1789127392.672335:0:12098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df68265d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81b0e267-d7e0-4043-b34e-eec2dc4c5a6b+6:12285:x1876035733918336:12345-192.168.206.40@tcp:101:lsof.0 Request processed in 619us (862us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127392.672342:0:12098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 239 00000100:00080000:2.0:1789127392.672674:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789127392.691069:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127393.715359:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127394.739038:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127394.805665:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789127394.805746:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae0412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1876035752775424:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789127394.805838:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127394.806019:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752775424 00000100:00100000:2.0:1789127394.806027:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752775424 00000100:00080000:0.0:1789127394.806080:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789127394.806091:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789127394.806100:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeabad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876035752775424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789127394.806134:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789127394.806186:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeabad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876035752775424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127394.806193:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789127394.806221:0:3301:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:0.0:1789127394.806234:0:3301:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:0.0:1789127394.806259:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae0412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1876035752775424:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789127394.806292:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae0421c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3301:1876035752775552:0@lo:400:kworker.0 00000100:00100000:0.0:1789127394.806326:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127394.806332:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae040000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1876035752775936:0@lo:400:kworker.0 00000100:00100000:0.0:1789127394.806350:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae041a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1876035752776064:0@lo:400:kworker.0 00000100:00100000:3.0:1789127394.806361:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127394.806371:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127394.806389:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae0403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876035752775680:0@lo:400:kworker.0 00000100:00100000:0.0:1789127394.806393:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752776064 00000100:00100000:0.0:1789127394.806396:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752776064 00000100:00100000:0.0:1789127394.806428:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1789127394.806433:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127394.806435:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6820be580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876035752776064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127394.806460:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789127394.806465:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae041e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1876035752775808:0@lo:400:kworker.0 00000100:00100000:0.0:1789127394.806467:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6820be580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876035752776064:12345-0@lo:400:kworker.0 Request processed in 33us (95us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127394.806474:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1789127394.806484:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752775680 00000100:00100000:3.0:1789127394.806486:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127394.806486:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752775680 00000100:00100000:0.0:1789127394.806500:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752775808 00000100:00100000:0.0:1789127394.806503:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752775808 00000100:00100000:3.0:1789127394.806509:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752775552 00000100:00100000:3.0:1789127394.806512:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752775552 00000100:00100000:0.0:1789127394.806516:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1789127394.806520:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae040b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876035752775680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127394.806534:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1789127394.806540:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df788035850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:3301:x1876035752775552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127394.806568:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae040b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876035752775680:12345-0@lo:400:kworker.0 Request processed in 47us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127394.806575:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1789127394.806576:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df788035850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:3301:x1876035752775552:12345-0@lo:400:kworker.0 Request processed in 37us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127394.806582:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:0.0:1789127394.806596:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1789127394.806602:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae043840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876035752775808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127394.806616:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752775936 00000100:00100000:3.0:1789127394.806619:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752775936 00000100:00100000:0.0:1789127394.806627:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae043840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876035752775808:12345-0@lo:400:kworker.0 Request processed in 26us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127394.806642:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1789127394.806644:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789127394.806649:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae0412c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1876035752775936:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789127394.806658:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789127394.806661:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789127394.806677:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae041a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1876035752776064:0@lo:400:kworker.0 00000100:00100000:3.0:1789127394.806680:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae0412c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1876035752775936:12345-0@lo:400:kworker.0 Request processed in 31us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127394.806685:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae0421c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3301:1876035752775552:0@lo:400:kworker.0 00000100:00100000:3.0:1789127394.806686:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789127394.812327:0:3300:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:3.0:1789127394.812338:0:3300:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8df7ae043480, transno 4294967310 00000100:00100000:3.0:1789127394.812356:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae040000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1876035752775936:0@lo:400:kworker.0 00000100:00100000:3.0:1789127394.812784:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae041e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1876035752775808:0@lo:400:kworker.0 00000100:00100000:3.0:1789127394.812811:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae0403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876035752775680:0@lo:400:kworker.0 00000100:00100000:0.0:1789127395.559162:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127395.559205:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127395.559238:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127395.559262:0:8063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733918848 00000100:00100000:0.0:1789127395.559270:0:8063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733918848 00000100:00100000:0.0:1789127395.559320:0:8063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 87 00000100:00100000:0.0:1789127395.559329:0:8063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6820be940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+7:2348:x1876035733918848:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:0.0:1789127395.559398:0:8063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6820be940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+7:2348:x1876035733918848:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 70us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127395.559405:0:8063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 87 00000100:00100000:0.0:1789127395.559436:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733918464 00000100:00100000:0.0:1789127395.559440:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733918464 00000100:00100000:0.0:1789127395.559471:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 331 00000100:00100000:0.0:1789127395.559479:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df788034050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d829a69b-d740-4e4c-8301-ef09c9d45165+13:2348:x1876035733918464:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:0.0:1789127395.559507:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df788034050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d829a69b-d740-4e4c-8301-ef09c9d45165+13:2348:x1876035733918464:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 30us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127395.559513:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 331 00000100:00080000:0.0:1789127395.559647:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789127395.560886:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733918592 00000100:00100000:2.0:1789127395.560907:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733918592 00000100:00100000:2.0:1789127395.560955:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 170 00000100:00100000:2.0:1789127395.560965:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6820bf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+20:2348:x1876035733918592:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:2.0:1789127395.561041:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6820bf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+20:2348:x1876035733918592:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 77us (1887us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127395.561048:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 170 00000100:00100000:3.0:1789127395.561217:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127395.561262:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127395.561282:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733918720 00000100:00100000:3.0:1789127395.561286:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733918720 00000100:00100000:3.0:1789127395.561326:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 88 00000100:00100000:3.0:1789127395.561335:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae0403c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+5:2348:x1876035733918720:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:3.0:1789127395.561375:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae0403c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+5:2348:x1876035733918720:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 41us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127395.561382:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 88 00000100:00100000:3.0:1789127395.561401:0:12098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733918976 00000100:00100000:3.0:1789127395.561405:0:12098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733918976 00000100:00100000:3.0:1789127395.561436:0:12098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 171 00000100:00100000:3.0:1789127395.561444:0:12098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae041e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81b0e267-d7e0-4043-b34e-eec2dc4c5a6b+6:2348:x1876035733918976:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:3.0:1789127395.561473:0:12098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae041e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81b0e267-d7e0-4043-b34e-eec2dc4c5a6b+6:2348:x1876035733918976:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 30us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127395.561479:0:12098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 171 00000100:00080000:0.0:1789127395.561870:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789127395.561875:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789127395.767173:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789127395.828198:0:12084:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789127395.828206:0:12084:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789127395.828464:0:12084:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:2.0:1789127395.828471:0:12084:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789127395.833270:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7aeab83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752776192:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789127395.833338:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127395.833406:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752776192 00000100:00100000:3.0:1789127395.833413:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752776192 00000100:00100000:3.0:1789127395.833453:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789127395.833462:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae043480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876035752776192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789127395.833494:0:10333:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789127395.833538:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae043480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876035752776192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127395.833545:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789127395.833597:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7aeab83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752776192:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1789127396.200558:0:13167:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 07:49:53 (1789127393) 00010000:00010000:0.0:1789127396.790487:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789127396.927247:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:3.0:1789127396.927276:0:5852:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:1.0:1789127396.927442:0:5863:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:1.0:1789127396.927455:0:5863:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:1.0:1789127397.812655:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127398.835064:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127399.859017:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127399.923031:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789127399.923064:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6827c3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1876035752776704:0@lo:400:kworker.0 00000100:00100000:0.0:1789127399.923076:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6820bcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876035752776576:0@lo:400:kworker.0 00000100:00100000:1.0:1789127399.923166:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df79a3a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1876035752776832:0@lo:400:kworker.0 00000100:00100000:2.0:1789127399.923249:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6820bc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3300:1876035752776448:0@lo:400:kworker.0 00000100:00100000:3.0:1789127399.924467:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127399.924566:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae040000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752776320:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789127399.924606:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127399.924676:0:10285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752776704 00000100:00100000:3.0:1789127399.924684:0:10285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752776704 00000100:00100000:3.0:1789127399.924770:0:10285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1789127399.924771:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127399.924785:0:10285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae0421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876035752776704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127399.924828:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df78efcf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1876035752777088:0@lo:400:kworker.0 00000100:00100000:0.0:1789127399.924866:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127399.924888:0:10285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae0421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876035752776704:12345-0@lo:400:kworker.0 Request processed in 103us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127399.924897:0:10285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00080000:0.0:1789127399.924911:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789127399.924921:0:10285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752776576 00000100:00100000:3.0:1789127399.924925:0:10285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752776576 00000100:00100000:0.0:1789127399.924929:0:8063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752777088 00000100:00100000:0.0:1789127399.924934:0:8063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752777088 00000100:00100000:3.0:1789127399.924951:0:10285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1789127399.924962:0:10285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeb17840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876035752776576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127399.924977:0:8063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789127399.924987:0:8063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7906292c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1876035752777088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127399.925005:0:10285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeb17840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876035752776576:12345-0@lo:400:kworker.0 Request processed in 45us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127399.925012:0:10285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1789127399.925030:0:8063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7906292c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1876035752777088:12345-0@lo:400:kworker.0 Request processed in 44us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127399.925037:0:8063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:0.0:1789127399.925056:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789127399.925068:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6827c3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1876035752776704:0@lo:400:kworker.0 00000100:00100000:0.0:1789127399.925080:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6820bcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876035752776576:0@lo:400:kworker.0 00000100:00100000:0.0:1789127399.925095:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df78efcf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1876035752777088:0@lo:400:kworker.0 00000100:00100000:0.0:1789127399.925129:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752776320 00000100:00100000:0.0:1789127399.925133:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752776320 00000100:00100000:0.0:1789127399.925166:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789127399.925173:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae041a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876035752776320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789127399.925203:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789127399.925236:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae041a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876035752776320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127399.925242:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789127399.925856:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae040000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752776320:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789127399.929098:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127399.929098:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127399.929231:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752776832 00000100:00100000:0.0:1789127399.929242:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752776832 00000100:00100000:0.0:1789127399.929332:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789127399.929344:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeabb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1876035752776832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127399.929430:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeabb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1876035752776832:12345-0@lo:400:kworker.0 Request processed in 88us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127399.929439:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:1.0:1789127399.936422:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789127399.936512:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df79a3a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1876035752776832:0@lo:400:kworker.0 00000100:00100000:2.0:1789127399.938883:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df78efced00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1876035752776960:0@lo:400:kworker.0 00000100:00100000:2.0:1789127399.938965:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127399.940285:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752776960 00000100:00100000:1.0:1789127399.940299:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752776960 00000100:00100000:1.0:1789127399.940396:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1789127399.940409:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bb96d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876035752776960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127399.940507:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bb96d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876035752776960:12345-0@lo:400:kworker.0 Request processed in 100us (1541us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127399.940515:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1789127399.940634:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df78efced00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1876035752776960:0@lo:400:kworker.0 00000100:00100000:3.0:1789127399.940893:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752776448 00000100:00100000:3.0:1789127399.940900:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752776448 00000100:00100000:3.0:1789127399.940980:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1789127399.940989:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df788035450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:3300:x1876035752776448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127399.941046:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df788035450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:3300:x1876035752776448:12345-0@lo:400:kworker.0 Request processed in 58us (11958us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127399.941071:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00080000:0.0:1789127399.941161:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789127399.941536:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6820bc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3300:1876035752776448:0@lo:400:kworker.0 00000100:00100000:2.0:1789127400.541375:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127400.541498:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733919232 00000100:00100000:0.0:1789127400.541513:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733919232 00000100:00100000:0.0:1789127400.541626:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 66 00000100:00100000:0.0:1789127400.541639:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bb96d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+19:12506:x1876035733919232:12345-192.168.206.40@tcp:35:umount.0 00000100:00080000:1.0:1789127400.541697:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789127400.542316:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bb96d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+20:12506:x1876035733919232:12345-192.168.206.40@tcp:35:umount.0 Request processed in 676us (952us total) trans 4294967522 rc 0/0 00000100:00100000:0.0:1789127400.542326:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 66 00000100:00100000:3.0:1789127400.551772:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127400.552075:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733919488 00000100:00100000:0.0:1789127400.552088:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733919488 00000100:00100000:0.0:1789127400.552158:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 67 00000100:00100000:0.0:1789127400.552170:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae040000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+20:12506:x1876035733919488:12345-192.168.206.40@tcp:35:umount.0 00000100:00100000:0.0:1789127400.552995:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae040000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+21:12506:x1876035733919488:12345-192.168.206.40@tcp:35:umount.0 Request processed in 746us (1156us total) trans 4294967523 rc 0/0 00000100:00100000:0.0:1789127400.553008:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 67 00000100:00100000:1.0:1789127400.566712:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127400.566853:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733919744 00000100:00100000:3.0:1789127400.566865:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733919744 00000100:00100000:3.0:1789127400.566944:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 68 00000100:00100000:3.0:1789127400.566956:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79156a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+21:12506:x1876035733919744:12345-192.168.206.40@tcp:35:umount.0 00000100:00100000:3.0:1789127400.569003:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79156a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+22:12506:x1876035733919744:12345-192.168.206.40@tcp:35:umount.0 Request processed in 2034us (2297us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1789127400.569018:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 68 00000100:00100000:2.0:1789127400.574280:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127400.574452:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733920000 00000100:00100000:0.0:1789127400.574464:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733920000 00000100:00100000:0.0:1789127400.574565:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 69 00000100:00100000:0.0:1789127400.574578:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bb96d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+22:12506:x1876035733920000:12345-192.168.206.40@tcp:35:umount.0 00000100:00100000:0.0:1789127400.575719:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bb96d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28762f98-a240-4662-a754-e28bbeb6cb4b+23:12506:x1876035733920000:12345-192.168.206.40@tcp:35:umount.0 Request processed in 1136us (1456us total) trans 4294967525 rc 0/0 00000100:00100000:0.0:1789127400.575733:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 69 00000100:00100000:0.0:1789127400.579874:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127400.580232:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733920128 00000100:00100000:3.0:1789127400.580244:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733920128 00000100:00100000:3.0:1789127400.580325:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 17 00000100:00100000:3.0:1789127400.580337:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df78605ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d829a69b-d740-4e4c-8301-ef09c9d45165+13:2348:x1876035733920128:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789127400.580358:0:8454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127400.580451:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df780031800/0xeeacf7c0243003e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b79f3 expref: 13 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127400.580474:0:8454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127400.580720:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df78605ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d829a69b-d740-4e4c-8301-ef09c9d45165+12:2348:x1876035733920128:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 385us (860us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127400.580730:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 17 00000100:00100000:1.0:1789127400.584916:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127400.584972:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127400.585020:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127400.585173:0:8063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733920512 00000100:00100000:0.0:1789127400.585184:0:8063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733920512 00000100:00100000:0.0:1789127400.585277:0:8063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 72 00000100:00100000:0.0:1789127400.585289:0:8063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeaba940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+7:2345:x1876035733920512:12345-192.168.206.40@tcp:9:umount.0 00000020:00000080:0.0:1789127400.585326:0:8063:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xeeacf7c0243009c1 00000020:00010000:0.0:1789127400.585335:0:8063:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8df78efd3800: total 0 00000100:00080000:0.0:1789127400.585341:0:8063:0:(import.c:65:import_set_state_nolock()) ffff8df78efd1000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789127400.585384:0:8063:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:0.0:1789127400.585727:0:8063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeaba940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28762f98-a240-4662-a754-e28bbeb6cb4b+5:2345:x1876035733920512:12345-192.168.206.40@tcp:9:umount.0 Request processed in 440us (826us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127400.585736:0:8063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 72 00000100:00100000:3.0:1789127400.586340:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733920768 00000100:00100000:3.0:1789127400.586349:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733920768 00000100:00100000:3.0:1789127400.586410:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733920640 00000100:00100000:3.0:1789127400.586414:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733920640 00000100:00100000:3.0:1789127400.586445:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 18 00000100:00100000:3.0:1789127400.586454:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeab9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d829a69b-d740-4e4c-8301-ef09c9d45165+13:2347:x1876035733920768:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789127400.586488:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127400.586514:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df7c2172a00/0xeeacf7c024300672 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7acc expref: 13 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127400.586548:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127400.586760:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeab9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d829a69b-d740-4e4c-8301-ef09c9d45165+12:2347:x1876035733920768:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 306us (1787us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127400.586767:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 18 00000100:00100000:3.0:1789127400.586809:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 19 00000100:00100000:3.0:1789127400.586817:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeab83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d829a69b-d740-4e4c-8301-ef09c9d45165+11:2347:x1876035733920640:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789127400.586827:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127400.586838:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df7bbd96e00/0xeeacf7c0243003af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b79bb expref: 11 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127400.586848:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127400.586867:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeab83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d829a69b-d740-4e4c-8301-ef09c9d45165+10:2347:x1876035733920640:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 51us (1847us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127400.586874:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 19 00000020:00010000:1.0:1789127400.587771:0:5819:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8df78efd3800: total 0 00010000:00010000:1.0:1789127400.587868:0:5819:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8df78efd3800, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1789127400.587927:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007b9a4f41/0xeeacf7c024300d64 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7ca1 expref: 4 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127400.587990:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b830ec46/0xeeacf7c024301402 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7e6f expref: 3 pid: 8063 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127400.588012:0:5819:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8df78efd3800, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1789127400.588042:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127400.588044:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127400.588047:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789127400.588058:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789127400.591454:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127400.591683:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733920896 00000100:00100000:0.0:1789127400.591696:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733920896 00000100:00100000:0.0:1789127400.591779:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 73 00000100:00100000:0.0:1789127400.591812:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79a3a12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+5:2345:x1876035733920896:12345-192.168.206.40@tcp:9:umount.0 00000020:00000080:0.0:1789127400.591854:0:6686:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xeeacf7c024300760 00000100:00080000:0.0:1789127400.591865:0:6686:0:(import.c:65:import_set_state_nolock()) ffff8df78efd2800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789127400.591909:0:6686:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00010000:00010000:1.0:1789127400.592271:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789127400.592282:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789127400.597880:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79a3a12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28762f98-a240-4662-a754-e28bbeb6cb4b+2:2345:x1876035733920896:12345-192.168.206.40@tcp:9:umount.0 Request processed in 6082us (6430us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127400.597893:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 73 00000100:00100000:2.0:1789127400.617068:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127400.617204:0:12098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733921920 00000100:00100000:3.0:1789127400.617215:0:12098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733921920 00000100:00100000:3.0:1789127400.617290:0:12098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 240 00000100:00100000:3.0:1789127400.617302:0:12098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bb96e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+23:2345:x1876035733921920:12345-192.168.206.40@tcp:39:umount.0 00000020:00000080:3.0:1789127400.617348:0:12098:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xeeacf7c0243003bd 00000020:00010000:3.0:1789127400.617373:0:12098:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8df79037e000: total 0 00000100:00080000:3.0:1789127400.617379:0:12098:0:(import.c:65:import_set_state_nolock()) ffff8df7903a3800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789127400.617415:0:12098:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000020:00010000:0.0:1789127400.617512:0:8511:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8df79037e000: total 0 00010000:00010000:0.0:1789127400.617604:0:8511:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8df79037e000, canceled 0 locks, left on hash table 14. 00010000:00010000:0.0:1789127400.617655:0:8511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8df79f06c900) 00010000:00010000:0.0:1789127400.617659:0:8511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127400.617671:0:8511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7c2172600/0xeeacf7c0243006e2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7ae1 expref: 22 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127400.617706:0:8511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df782a68a00) 00010000:00010000:0.0:1789127400.617708:0:8511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789127400.617712:0:8511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728600/0xeeacf7c024300dc6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7cbd expref: 22 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127400.617732:0:8511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8df79f06c100) 00010000:00010000:0.0:1789127400.617735:0:8511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789127400.617741:0:8511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97a00/0xeeacf7c0243013ed lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7e68 expref: 21 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127400.618006:0:8511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8df782d66800) 00010000:00010000:0.0:1789127400.618010:0:8511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789127400.618016:0:8511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c024300d25 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c8c expref: 21 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127400.618031:0:8511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8df782d66800) 00010000:00010000:0.0:1789127400.618033:0:8511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789127400.618039:0:8511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1000/0xeeacf7c024300d4f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c9a expref: 20 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127400.618056:0:8511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8df79f06c100) 00010000:00010000:0.0:1789127400.618061:0:8511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789127400.618090:0:8511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c0243013b5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7e5a expref: 19 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127400.618108:0:8511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8df79f06cd00) 00010000:00010000:0.0:1789127400.618111:0:8511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789127400.618115:0:8511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1e00/0xeeacf7c0243010c1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7d96 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127400.618127:0:8511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8df7906f6b00) 00010000:00010000:0.0:1789127400.618130:0:8511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789127400.618133:0:8511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df1200/0xeeacf7c024300a23 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7bc8 expref: 15 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127400.618145:0:8511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8df782d66a00) 00010000:00010000:0.0:1789127400.618147:0:8511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789127400.618150:0:8511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97400/0xeeacf7c0243006c6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7ada expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127400.618164:0:8511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8df782d66800) 00010000:00010000:0.0:1789127400.618167:0:8511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789127400.618170:0:8511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032dc00/0xeeacf7c024300c45 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7c54 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127400.618182:0:8511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8df7906f6b00) 00010000:00010000:0.0:1789127400.618185:0:8511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789127400.618188:0:8511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df79032d200/0xeeacf7c024300736 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7af6 expref: 12 pid: 10285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127400.618201:0:8511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8df79f06c100) 00010000:00010000:0.0:1789127400.618210:0:8511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789127400.618215:0:8511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729200/0xeeacf7c0243012e3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7e22 expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127400.618228:0:8511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8df79f06c100) 00010000:00010000:0.0:1789127400.618231:0:8511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789127400.618234:0:8511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c0243013d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7e61 expref: 10 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127400.618249:0:8511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8df79f06cd00) 00010000:00010000:0.0:1789127400.618252:0:8511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789127400.618255:0:8511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df798df0e00/0xeeacf7c024300de2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7cc4 expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127400.618269:0:8511:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8df79037e000, canceled 14 locks, left on hash table 0. 00010000:00010000:0.0:1789127400.618284:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127400.618287:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127400.618289:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127400.619223:0:12098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bb96e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28762f98-a240-4662-a754-e28bbeb6cb4b+7:2345:x1876035733921920:12345-192.168.206.40@tcp:39:umount.0 Request processed in 1911us (2158us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1789127400.619252:0:12098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 240 00000100:00100000:2.0:1789127400.688215:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127400.688316:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733922048 00000100:00100000:3.0:1789127400.688329:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733922048 00000100:00100000:3.0:1789127400.688456:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 175 00000100:00100000:3.0:1789127400.688468:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7bb96cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81b0e267-d7e0-4043-b34e-eec2dc4c5a6b+6:2346:x1876035733922048:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:3.0:1789127400.688615:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7bb96cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81b0e267-d7e0-4043-b34e-eec2dc4c5a6b+6:2346:x1876035733922048:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 140us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127400.688624:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 175 00000100:00080000:1.0:1789127400.688694:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789127400.883058:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127400.947515:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789127400.947560:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df68325de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1876035752777216:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789127400.947660:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127400.947749:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752777216 00000100:00100000:1.0:1789127400.947758:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752777216 00000100:00100000:1.0:1789127400.947847:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789127400.947858:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df68325e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876035752777216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789127400.947900:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789127400.947951:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df68325e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876035752777216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127400.947959:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789127400.948015:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df68325de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1876035752777216:0@lo:13:osp-pre-0-0.0 00000001:00100000:3.0:1789127401.030718:0:6714:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 28762f98-a240-4662-a754-e28bbeb6cb4b 00000020:00000080:3.0:1789127401.030731:0:6714:0:(genops.c:885:class_export_put()) final put ffff8df78efd7000/28762f98-a240-4662-a754-e28bbeb6cb4b 00000020:00000080:2.0:1789127401.034045:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df78efd7000/28762f98-a240-4662-a754-e28bbeb6cb4b for lustre-OST0000 00000020:00000080:0.0:1789127401.034742:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df78efd2800 for lustre-OST0000 00010000:00010000:1.0:1789127401.907115:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789127402.017145:0:7646:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 28762f98-a240-4662-a754-e28bbeb6cb4b 00000020:00000080:1.0:1789127402.017159:0:7646:0:(genops.c:885:class_export_put()) final put ffff8df78efd3800/28762f98-a240-4662-a754-e28bbeb6cb4b 00000020:00000080:1.0:1789127402.017201:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8df78efd3800/28762f98-a240-4662-a754-e28bbeb6cb4b for lustre-OST0001 00000020:00000080:1.0:1789127402.017261:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df78efd1000 for lustre-OST0001 00000001:00080000:3.0:1789127402.047318:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000001:00100000:3.0:1789127402.047346:0:5852:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 28762f98-a240-4662-a754-e28bbeb6cb4b 00000001:00080000:3.0:1789127402.047356:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:3.0:1789127402.047362:0:5852:0:(genops.c:885:class_export_put()) final put ffff8df79037e000/28762f98-a240-4662-a754-e28bbeb6cb4b 00000020:00000080:3.0:1789127402.047388:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df79037e000/28762f98-a240-4662-a754-e28bbeb6cb4b for lustre-MDT0000 00000020:00000080:3.0:1789127402.047458:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df7903a3800 for lustre-MDT0000 00000100:00100000:0.0:1789127402.821319:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127402.821476:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127402.822165:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127402.822232:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733922304 00000100:00100000:3.0:1789127402.822244:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733922304 00000100:00100000:1.0:1789127402.822456:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733922176 00000100:00100000:1.0:1789127402.822462:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733922176 00000100:00100000:1.0:1789127402.822560:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733922432 00000100:00100000:1.0:1789127402.822564:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733922432 00000100:00100000:1.0:1789127402.822587:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 20 00000100:00100000:1.0:1789127402.822598:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df78efced00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d829a69b-d740-4e4c-8301-ef09c9d45165+12:2348:x1876035733922176:12345-192.168.206.40@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1789127402.822769:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 21 00000100:00100000:0.0:1789127402.822779:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df78efcf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d829a69b-d740-4e4c-8301-ef09c9d45165+12:2348:x1876035733922432:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789127402.822817:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789127402.822842:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df79032d800/0xeeacf7c02430066b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7ac5 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127402.822888:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789127402.822956:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df78efcf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d829a69b-d740-4e4c-8301-ef09c9d45165+11:2348:x1876035733922432:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 178us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127402.822964:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 21 00010000:00010000:1.0:1789127402.824078:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789127402.824106:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df7ae729600/0xeeacf7c02430048f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7a08 expref: 10 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127402.824122:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789127402.824184:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df78efced00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d829a69b-d740-4e4c-8301-ef09c9d45165+9:2348:x1876035733922176:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 1586us (2706us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127402.824193:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 20 00000100:00100000:2.0:1789127402.826275:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 22 00000100:00100000:2.0:1789127402.826291:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df79062a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d829a69b-d740-4e4c-8301-ef09c9d45165+8:2348:x1876035733922304:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789127402.826308:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789127402.826357:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df7bbd97c00/0xeeacf7c024300496 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7a32 expref: 8 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127402.826377:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789127402.826454:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df79062a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d829a69b-d740-4e4c-8301-ef09c9d45165+7:2348:x1876035733922304:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 166us (5149us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127402.826462:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 22 00000100:00100000:0.0:1789127402.830901:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127402.831012:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733922688 00000100:00100000:1.0:1789127402.831024:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733922688 00000100:00100000:1.0:1789127402.831100:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 241 00000100:00100000:1.0:1789127402.831112:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6820bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81b0e267-d7e0-4043-b34e-eec2dc4c5a6b+6:2345:x1876035733922688:12345-192.168.206.40@tcp:39:umount.0 00000020:00000080:1.0:1789127402.831163:0:5830:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xeeacf7c0243004a4 00000020:00010000:1.0:1789127402.831173:0:5830:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8df790385800: total 0 00000100:00080000:1.0:1789127402.831179:0:5830:0:(import.c:65:import_set_state_nolock()) ffff8df790381800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789127402.831216:0:5830:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:1.0:1789127402.831708:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6820bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81b0e267-d7e0-4043-b34e-eec2dc4c5a6b+5:2345:x1876035733922688:12345-192.168.206.40@tcp:39:umount.0 Request processed in 596us (820us total) trans 4294967527 rc 0/0 00000100:00100000:1.0:1789127402.831738:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 241 00000020:00010000:2.0:1789127402.831940:0:8511:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8df790385800: total 0 00010000:00010000:2.0:1789127402.831946:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127402.831998:0:8511:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8df790385800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1789127402.832040:0:8511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df782a68a00) 00010000:00010000:2.0:1789127402.832044:0:8511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789127402.832055:0:8511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728000/0xeeacf7c024301410 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7e76 expref: 4 pid: 12098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127402.832078:0:8511:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8df790385800, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1789127402.832088:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127402.832090:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127402.832092:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789127402.832214:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789127402.852259:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127402.852418:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733922944 00000100:00100000:0.0:1789127402.852431:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733922944 00000100:00100000:0.0:1789127402.852509:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 333 00000100:00100000:0.0:1789127402.852521:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df788036c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d829a69b-d740-4e4c-8301-ef09c9d45165+7:2345:x1876035733922944:12345-192.168.206.40@tcp:251:umount.0 00000020:00000080:0.0:1789127402.852593:0:5825:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xeeacf7c02430039a 00000020:00010000:0.0:1789127402.852603:0:5825:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8df7a0324800: total 0 00000100:00080000:0.0:1789127402.852609:0:5825:0:(import.c:65:import_set_state_nolock()) ffff8df7a0326800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1789127402.852709:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df788036c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d829a69b-d740-4e4c-8301-ef09c9d45165+3:2345:x1876035733922944:12345-192.168.206.40@tcp:251:umount.0 Request processed in 189us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127402.852718:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 333 00000020:00010000:2.0:1789127402.852856:0:5819:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8df7a0324800: total 0 00010000:00010000:2.0:1789127402.852914:0:5819:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8df7a0324800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1789127402.852971:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df780030800/0xeeacf7c0243003ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b79fa expref: 2 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127402.852995:0:5819:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8df7a0324800, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1789127402.853005:0:5819:0:(genops.c:885:class_export_put()) final put ffff8df7a0324800/d829a69b-d740-4e4c-8301-ef09c9d45165 00010000:00010000:2.0:1789127402.853021:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127402.853023:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127402.853025:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789127402.853038:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8df7a0324800/d829a69b-d740-4e4c-8301-ef09c9d45165 for MGS 00000020:00000080:2.0:1789127402.853103:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df7a0326800 for MGS 00010000:00010000:1.0:1789127402.931345:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127403.955333:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789127404.979485:0:13368:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00010000:00010000:1.0:1789127404.981170:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789127405.005932:0:13368:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1789127405.005982:0:13368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df79032d000/0xeeacf7c02430042d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c024300434 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127405.005998:0:13368:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df79032d000/0xeeacf7c02430042d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xeeacf7c024300434 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127405.006023:0:13368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df79032d000/0xeeacf7c02430042d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xeeacf7c024300434 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127405.006030:0:13368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.140@tcp lock: ffff8df79032d000/0xeeacf7c02430042d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xeeacf7c024300434 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127405.006057:0:13368:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789127405.006063:0:13368:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1789127405.006103:0:13368:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789127405.006107:0:13368:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789127405.006113:0:13368:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789127405.006135:0:13368:0:(import.c:65:import_set_state_nolock()) ffff8df7bb584000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1789127405.006223:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae042580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876035752777344:0@lo:39:umount.0 00000100:00100000:2.0:1789127405.006290:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127405.006513:0:12098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752777344 00000100:00100000:3.0:1789127405.006520:0:12098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752777344 00010000:00010000:1.0:1789127405.006524:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789127405.006541:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.140@tcp lock: ffff8df79032d000/0xeeacf7c02430042d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xeeacf7c024300434 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127405.006550:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df79032d000 already unused, calling callback (ffffffffc1da1c20) 10000000:00010000:1.0:1789127405.006553:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.140@tcp lock: ffff8df79032d000/0xeeacf7c02430042d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xeeacf7c024300434 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127405.006562:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: ffff8df79032d000/0xeeacf7c02430042d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xeeacf7c024300434 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789127405.006568:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: ffff8df79032d000/0xeeacf7c02430042d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xeeacf7c024300434 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789127405.006574:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789127405.006577:0:5818:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1789127405.006580:0:5818:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1789127405.006605:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.140@tcp lock: ffff8df79032d000/0xeeacf7c02430042d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xeeacf7c024300434 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127405.006610:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789127405.006614:0:12098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1789127405.006625:0:12098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae2f8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876035752777344:12345-0@lo:39:umount.0 00010000:00010000:1.0:1789127405.006633:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.140@tcp lock: ffff8df79032d000/0xeeacf7c02430042d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xeeacf7c024300434 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127405.006641:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: ffff8df79032d000/0xeeacf7c02430042d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xeeacf7c024300434 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1789127405.006650:0:12098:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xeeacf7c0243001a9 00000100:00080000:3.0:1789127405.006658:0:12098:0:(import.c:65:import_set_state_nolock()) ffff8df7af67c000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1789127405.006665:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127405.006668:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127405.006671:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127405.006685:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df68325e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3303:1876035752777472:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789127405.006725:0:12098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae2f8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+1:3299:x1876035752777344:12345-0@lo:39:umount.0 Request processed in 99us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127405.006730:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127405.006740:0:12098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:3.0:1789127405.006762:0:12098:0:(genops.c:885:class_export_put()) final put ffff8df7af679000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00100000:1.0:1789127405.006784:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752777472 00000100:00100000:1.0:1789127405.006807:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752777472 00000100:00100000:1.0:1789127405.006843:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789127405.006851:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df68325f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:3303:x1876035752777472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789127405.006860:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789127405.006874:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df79032d600/0xeeacf7c024300434 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xeeacf7c02430042d expref: 19 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127405.006885:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789127405.006913:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df68325f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+18:3303:x1876035752777472:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127405.006920:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789127405.006954:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df68325e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3303:1876035752777472:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789127405.010489:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789127405.010505:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df7af679000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1789127405.010592:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df7af67c000 for lustre-MDT0000 00000100:00080000:2.0:1789127405.010650:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8df7bb584000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1789127405.010667:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae042580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876035752777344:0@lo:39:umount.0 00000100:00080000:2.0:1789127405.011108:0:13368:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789127405.011113:0:13368:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789127405.011118:0:13368:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1789127405.012523:0:13368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df780031400/0xeeacf7c02430043b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c024300442 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127405.012549:0:13368:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df780031400/0xeeacf7c02430043b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xeeacf7c024300442 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127405.012570:0:13368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df780031400/0xeeacf7c02430043b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xeeacf7c024300442 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127405.012577:0:13368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.140@tcp lock: ffff8df780031400/0xeeacf7c02430043b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xeeacf7c024300442 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127405.012603:0:13368:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789127405.012610:0:13368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df7c2051c00/0xeeacf7c024300354 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c02430035b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127405.012616:0:13368:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df7c2051c00/0xeeacf7c024300354 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xeeacf7c02430035b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127405.012622:0:13368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df7c2051c00/0xeeacf7c024300354 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xeeacf7c02430035b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127405.012628:0:13368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.140@tcp lock: ffff8df7c2051c00/0xeeacf7c024300354 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xeeacf7c02430035b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127405.012642:0:13368:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789127405.012648:0:13368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df7bbd97200/0xeeacf7c024300695 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c02430069c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127405.012653:0:13368:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df7bbd97200/0xeeacf7c024300695 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xeeacf7c02430069c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127405.012659:0:13368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df7bbd97200/0xeeacf7c024300695 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xeeacf7c02430069c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127405.012674:0:13368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.140@tcp lock: ffff8df7bbd97200/0xeeacf7c024300695 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xeeacf7c02430069c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127405.012684:0:13368:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1789127405.012690:0:13368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df780030400/0xeeacf7c024300108 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c02430010f expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127405.012696:0:13368:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df780030400/0xeeacf7c024300108 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xeeacf7c02430010f expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127405.012702:0:13368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df780030400/0xeeacf7c024300108 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xeeacf7c02430010f expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127405.012707:0:13368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.140@tcp lock: ffff8df780030400/0xeeacf7c024300108 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xeeacf7c02430010f expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127405.012714:0:13368:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:3.0:1789127405.012716:0:13368:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1789127405.012743:0:13368:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1789127405.012747:0:13368:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1789127405.012751:0:13368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789127405.012756:0:13368:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00000020:00080000:3.0:1789127405.012763:0:13368:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8df79037a800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789127405.012768:0:13368:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8df6811a2000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789127405.012775:0:13368:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff8df790385800 81b0e267-d7e0-4043-b34e-eec2dc4c5a6b 192.168.206.40@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789127405.012779:0:13368:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff8df7907fced8) has exports, disconnecting them 00000020:00080000:3.0:1789127405.012783:0:13368:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8df79037a800), last request at 1789127399 00010000:00010000:2.0:1789127405.013181:0:8511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789127405.013188:0:8511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.140@tcp lock: ffff8df780031400/0xeeacf7c02430043b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xeeacf7c024300442 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127405.013196:0:8511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df780031400 already unused, calling callback (ffffffffc1da1c20) 10000000:00010000:2.0:1789127405.013200:0:8511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.140@tcp lock: ffff8df780031400/0xeeacf7c02430043b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xeeacf7c024300442 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127405.013208:0:8511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: ffff8df780031400/0xeeacf7c02430043b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xeeacf7c024300442 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789127405.013215:0:8511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: ffff8df780031400/0xeeacf7c02430043b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xeeacf7c024300442 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127405.013221:0:8511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789127405.013223:0:8511:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:2.0:1789127405.013225:0:8511:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:2.0:1789127405.013262:0:8511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.140@tcp lock: ffff8df780031400/0xeeacf7c02430043b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xeeacf7c024300442 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127405.013268:0:8511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789127405.013291:0:8511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.140@tcp lock: ffff8df780031400/0xeeacf7c02430043b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xeeacf7c024300442 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127405.013298:0:8511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: ffff8df780031400/0xeeacf7c02430043b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xeeacf7c024300442 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127405.013312:0:8511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789127405.013316:0:8511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.140@tcp lock: ffff8df7c2051c00/0xeeacf7c024300354 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xeeacf7c02430035b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127405.013323:0:8511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7c2051c00 already unused, calling callback (ffffffffc1da1c20) 10000000:00010000:2.0:1789127405.013326:0:8511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.140@tcp lock: ffff8df7c2051c00/0xeeacf7c024300354 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xeeacf7c02430035b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127405.013333:0:8511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: ffff8df7c2051c00/0xeeacf7c024300354 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xeeacf7c02430035b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789127405.013340:0:8511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: ffff8df7c2051c00/0xeeacf7c024300354 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xeeacf7c02430035b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127405.013345:0:8511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1789127405.013346:0:8511:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1789127405.013348:0:8511:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1789127405.013362:0:8511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.140@tcp lock: ffff8df7c2051c00/0xeeacf7c024300354 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xeeacf7c02430035b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127405.013367:0:8511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00000080:3.0:1789127405.013572:0:13368:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xeeacf7c02430031c 00000100:00080000:3.0:1789127405.013588:0:13368:0:(import.c:65:import_set_state_nolock()) ffff8df790379800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1789127405.013625:0:13368:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8df79037a800): rc 0 00000020:00000080:3.0:1789127405.013627:0:13368:0:(genops.c:885:class_export_put()) final put ffff8df79037a800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1789127405.013639:0:13368:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8df6811a2000), last request at 1789127399 00000020:00000080:3.0:1789127405.013642:0:13368:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xeeacf7c024300251 00000100:00080000:3.0:1789127405.013647:0:13368:0:(import.c:65:import_set_state_nolock()) ffff8df6811a1000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1789127405.013653:0:13368:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8df6811a2000): rc 0 00000020:00000080:3.0:1789127405.013654:0:13368:0:(genops.c:885:class_export_put()) final put ffff8df6811a2000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:3.0:1789127405.013660:0:13368:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa7e042bc7ae0 00000100:00080000:3.0:1789127405.013676:0:13368:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789127405.013679:0:13368:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:3.0:1789127405.013690:0:13368:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1789127405.013744:0:13368:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1789127405.013758:0:13368:0:(import.c:65:import_set_state_nolock()) ffff8df7af45d000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1789127405.013769:0:13368:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789127405.013771:0:13368:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:3.0:1789127405.013778:0:13368:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1789127405.013883:0:13368:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1789127405.013891:0:13368:0:(import.c:65:import_set_state_nolock()) ffff8df7ae060000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1789127405.013917:0:13368:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8df7907fced8) has no exports 00010000:00010000:2.0:1789127405.014460:0:8511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.140@tcp lock: ffff8df7c2051c00/0xeeacf7c024300354 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xeeacf7c02430035b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127405.014479:0:8511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: ffff8df7c2051c00/0xeeacf7c024300354 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xeeacf7c02430035b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127405.014497:0:8511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789127405.014501:0:8511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.140@tcp lock: ffff8df7bbd97200/0xeeacf7c024300695 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xeeacf7c02430069c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127405.014507:0:8511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd97200 already unused, calling callback (ffffffffc1da1c20) 10000000:00010000:2.0:1789127405.014510:0:8511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.140@tcp lock: ffff8df7bbd97200/0xeeacf7c024300695 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xeeacf7c02430069c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127405.014518:0:8511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: ffff8df7bbd97200/0xeeacf7c024300695 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xeeacf7c02430069c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789127405.014524:0:8511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: ffff8df7bbd97200/0xeeacf7c024300695 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xeeacf7c02430069c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127405.014540:0:8511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1789127405.014543:0:8511:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1789127405.014545:0:8511:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1789127405.014564:0:8511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.140@tcp lock: ffff8df7bbd97200/0xeeacf7c024300695 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xeeacf7c02430069c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127405.014570:0:8511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789127405.014577:0:8511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.140@tcp lock: ffff8df7bbd97200/0xeeacf7c024300695 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xeeacf7c02430069c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127405.014582:0:8511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: ffff8df7bbd97200/0xeeacf7c024300695 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xeeacf7c02430069c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127405.014599:0:8511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789127405.014603:0:8511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.140@tcp lock: ffff8df780030400/0xeeacf7c024300108 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xeeacf7c02430010f expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127405.014608:0:8511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df780030400 already unused, calling callback (ffffffffc1da1c20) 10000000:00010000:2.0:1789127405.014611:0:8511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.140@tcp lock: ffff8df780030400/0xeeacf7c024300108 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xeeacf7c02430010f expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127405.014617:0:8511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: ffff8df780030400/0xeeacf7c024300108 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xeeacf7c02430010f expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789127405.014622:0:8511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: ffff8df780030400/0xeeacf7c024300108 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xeeacf7c02430010f expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127405.014627:0:8511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1789127405.014629:0:8511:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1789127405.014630:0:8511:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1789127405.014642:0:8511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.140@tcp lock: ffff8df780030400/0xeeacf7c024300108 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xeeacf7c02430010f expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127405.014646:0:8511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789127405.014651:0:8511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.140@tcp lock: ffff8df780030400/0xeeacf7c024300108 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xeeacf7c02430010f expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127405.014656:0:8511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: ffff8df780030400/0xeeacf7c024300108 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xeeacf7c02430010f expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127405.014667:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127405.014669:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127405.014675:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127405.014694:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae2f9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3300:1876035752777600:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789127405.014755:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127405.014818:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df682e73840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3300:1876035752778368:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789127405.014837:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127405.014861:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789127405.014868:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df682e72d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3300:1876035752777728:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789127405.014884:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:2.0:1789127405.014911:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8df79037a800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1789127405.014962:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8df6811a2000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1789127405.014984:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df790379800 for lustre-MDT0000 00000020:00000080:2.0:1789127405.014988:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df6811a1000 for lustre-MDT0000 00000100:00100000:2.0:1789127405.015000:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae040000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1876035752777856:0@lo:9:umount.0 00000100:00100000:2.0:1789127405.015028:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127405.015046:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae040780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1876035752778112:0@lo:9:umount.0 00000100:00100000:2.0:1789127405.015064:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127405.016194:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae042580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:0:1876035752777984:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789127405.016231:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789127405.016247:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df682e73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3302:1876035752778240:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789127405.016291:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127405.016331:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752777600 00000100:00100000:1.0:1789127405.016337:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752777600 00000100:00100000:1.0:1789127405.016373:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752778368 00000100:00100000:1.0:1789127405.016387:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752778368 00000100:00100000:1.0:1789127405.016403:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752777728 00000100:00100000:1.0:1789127405.016405:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752777728 00000100:00100000:1.0:1789127405.016416:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752778240 00000100:00100000:1.0:1789127405.016418:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752778240 00000100:00100000:1.0:1789127405.016432:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789127405.016440:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df78605a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+21:3300:x1876035752777600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789127405.016452:0:8454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789127405.016469:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df79032d400/0xeeacf7c024300442 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xeeacf7c02430043b expref: 21 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127405.016483:0:8454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789127405.016523:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df78605a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+20:3300:x1876035752777600:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (1766us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127405.016540:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789127405.016588:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789127405.016594:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df682e70b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+19:3300:x1876035752778368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789127405.016602:0:8454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789127405.016611:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df7c2051600/0xeeacf7c02430010f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xeeacf7c024300108 expref: 19 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127405.016623:0:8454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789127405.016647:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df682e70b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+18:3300:x1876035752778368:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (1808us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127405.016654:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789127405.016667:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789127405.016672:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df682e72580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+17:3300:x1876035752777728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789127405.016679:0:8454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789127405.016694:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df798df0600/0xeeacf7c02430035b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xeeacf7c024300354 expref: 17 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127405.016707:0:8454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789127405.016730:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df682e72580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+16:3300:x1876035752777728:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (1844us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127405.016736:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789127405.016748:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789127405.016753:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df68325e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+15:3302:x1876035752778240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789127405.016760:0:8454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789127405.016768:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df7c2173400/0xeeacf7c02430069c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xeeacf7c024300695 expref: 15 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127405.016776:0:8454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789127405.016819:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df68325e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+14:3302:x1876035752778240:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127405.016825:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789127405.016858:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df682e73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3302:1876035752778240:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789127405.016885:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df682e72d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3300:1876035752777728:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789127405.016892:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae2f9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3300:1876035752777600:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789127405.016900:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df682e73840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3300:1876035752778368:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789127405.017004:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127405.017676:0:8063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752777856 00000100:00100000:2.0:1789127405.017683:0:8063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752777856 00000100:00080000:0.0:1789127405.018116:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789127405.018671:0:8063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752778112 00000100:00100000:2.0:1789127405.018677:0:8063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752778112 00000100:00100000:3.0:1789127405.018704:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00080000:1.0:1789127405.018887:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789127405.018944:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df787b8e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1876035752777856:12345-0@lo:9:umount.0 00000020:00000080:3.0:1789127405.019110:0:6689:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xeeacf7c02430029e 00000100:00080000:3.0:1789127405.019120:0:6689:0:(import.c:65:import_set_state_nolock()) ffff8df7b45f8800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789127405.019187:0:6689:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:2.0:1789127405.019211:0:8063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789127405.019221:0:8063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df787b8de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1876035752778112:12345-0@lo:9:umount.0 00000100:00100000:3.0:1789127405.019615:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df787b8e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3299:x1876035752777856:12345-0@lo:9:umount.0 Request processed in 675us (4583us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127405.019635:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00010000:1.0:1789127405.019678:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127405.019893:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789127405.019926:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8df7af45d000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1789127405.019941:0:3299:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1789127405.019943:0:3299:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789127405.019947:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae040000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1876035752777856:0@lo:9:umount.0 00000020:00000080:2.0:1789127405.020332:0:8063:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xeeacf7c024300385 00000100:00080000:2.0:1789127405.020508:0:8063:0:(import.c:65:import_set_state_nolock()) ffff8df682adc800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789127405.020560:0:8063:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:2.0:1789127405.020844:0:8063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df787b8de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3299:x1876035752778112:12345-0@lo:9:umount.0 Request processed in 1623us (5776us total) trans 0 rc 0/0 00000100:00080000:3.0:1789127405.020862:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8df7ae060000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1789127405.020867:0:8063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000004:00080000:3.0:1789127405.020876:0:3299:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1789127405.020880:0:3299:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789127405.020885:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae040780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1876035752778112:0@lo:9:umount.0 00010000:00010000:1.0:1789127405.021256:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1789127405.035084:0:13368:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8df7907fced8) has no exports 00000100:00100000:0.0:1789127405.043378:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6826a6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1876035752778496:0@lo:400:kworker.0 00000100:00100000:1.0:1789127405.043385:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6826a70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1876035752778624:0@lo:400:kworker.0 00000100:00100000:1.0:1789127405.046160:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127405.047158:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127405.048320:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752778624 00000100:00100000:2.0:1789127405.048330:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752778624 00000100:00100000:2.0:1789127405.048372:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752778496 00000100:00100000:2.0:1789127405.048376:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752778496 00000100:00100000:2.0:1789127405.048395:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1789127405.048403:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df68325f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3302:x1876035752778624:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1789127405.048412:0:5831:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1789127405.048479:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df68325f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3302:x1876035752778624:12345-0@lo:400:kworker.0 Request processed in 76us (2325us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789127405.048487:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1789127405.048503:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1789127405.048507:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df68325cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3301:x1876035752778496:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1789127405.048512:0:5831:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1789127405.048551:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df68325cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3301:x1876035752778496:12345-0@lo:400:kworker.0 Request processed in 42us (1395us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789127405.048557:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:1.0:1789127405.048705:0:3301:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789127405.048720:0:3301:0:(import.c:65:import_set_state_nolock()) ffff8df681af9800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1789127405.048724:0:3301:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1789127405.051883:0:3302:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789127405.051891:0:3302:0:(import.c:65:import_set_state_nolock()) ffff8df682adb800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1789127405.051895:0:3302:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1789127405.051900:0:3302:0:(import.c:65:import_set_state_nolock()) ffff8df682adb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789127405.051905:0:3302:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 158 00000100:00080000:0.0:1789127405.051913:0:3302:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8df682adb800 using connection 192.168.206.140@tcp/0@lo 00000100:00100000:0.0:1789127405.051959:0:3302:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df6820bd2c0 x1876035752778752/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789127405.052004:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6826a70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1876035752778624:0@lo:400:kworker.0 00000100:00100000:2.0:1789127405.052134:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6820bd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3299:1876035752778752:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1789127405.052189:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127405.052262:0:12098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752778752 00000100:00100000:0.0:1789127405.052267:0:12098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752778752 00000100:00100000:0.0:1789127405.052329:0:12098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1789127405.052336:0:12098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6826a7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3299:x1876035752778752:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:0.0:1789127405.052352:0:12098:0:(ldlm_lib.c:1241:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:1.0:1789127405.063841:0:3301:0:(import.c:65:import_set_state_nolock()) ffff8df681af9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789127405.063851:0:3301:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 139 00000100:00080000:1.0:1789127405.063860:0:3301:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8df681af9800 using connection 192.168.206.140@tcp/0@lo 00000100:00100000:1.0:1789127405.063899:0:3301:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df7ae2f9680 x1876035752778880/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789127405.063927:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6826a6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1876035752778496:0@lo:400:kworker.0 00000100:00100000:2.0:1789127405.063988:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae2f9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3299:1876035752778880:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1789127405.064050:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127405.066145:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752778880 00000100:00100000:1.0:1789127405.066155:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752778880 00000100:00100000:1.0:1789127405.066197:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1789127405.066204:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6826a4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3299:x1876035752778880:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:1.0:1789127405.066222:0:5832:0:(ldlm_lib.c:1241:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1789127405.066290:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6826a4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3299:x1876035752778880:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 84us (2239us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789127405.066299:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00080000:1.0:1789127405.066347:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8df681af9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789127405.066352:0:3299:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789127405.066356:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae2f9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3299:1876035752778880:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1789127405.082320:0:12098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6826a7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3299:x1876035752778752:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 29976us (30122us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789127405.082334:0:12098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:2.0:1789127405.082493:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8df682adb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789127405.082499:0:3299:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789127405.082503:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6820bd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3299:1876035752778752:0@lo:38:ptlrpcd_00_02.0 00000020:00000080:3.0:1789127405.092019:0:13368:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xeeacf7c024300163 00000020:00000080:3.0:1789127405.092033:0:13368:0:(genops.c:885:class_export_put()) final put ffff8df7af67c800/lustre-QMT0000_UUID 00000020:01000000:3.0:1789127405.092054:0:13368:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1789127405.092148:0:13368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789127405.092159:0:13368:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789127405.092164:0:13368:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff8df7907f9a48) has no exports 00000020:00000080:2.0:1789127405.092385:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df7af67c800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1789127405.097483:0:13368:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xeeacf7c02430015c 00000020:00000080:0.0:1789127405.097497:0:13368:0:(genops.c:885:class_export_put()) final put ffff8df7af493000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789127405.103325:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df7af493000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789127405.109950:0:13368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789127405.109966:0:13368:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1789127405.109972:0:13368:0:(genops.c:885:class_export_put()) final put ffff8df7bbde6800/lustre-QMT0000_UUID 00000020:00000080:1.0:1789127405.109991:0:13368:0:(genops.c:844:class_export_destroy()) destroying export ffff8df7bbde6800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1789127405.109998:0:13368:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:1.0:1789127406.003117:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789127406.121241:0:6714:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789127406.121254:0:6714:0:(genops.c:885:class_export_put()) final put ffff8df7b45fd800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789127406.121357:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df7b45fd800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1789127406.121427:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df7b45f8800 for lustre-OST0000 00010000:00010000:3.0:1789127407.028119:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789127407.170760:0:5852:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 81b0e267-d7e0-4043-b34e-eec2dc4c5a6b 00000001:00080000:0.0:1789127407.170774:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:0.0:1789127407.170780:0:5852:0:(genops.c:885:class_export_put()) final put ffff8df790385800/81b0e267-d7e0-4043-b34e-eec2dc4c5a6b 00000020:00000080:0.0:1789127407.170825:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8df790385800/81b0e267-d7e0-4043-b34e-eec2dc4c5a6b for lustre-MDT0000 00000020:00000080:0.0:1789127407.170874:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df790381800 for lustre-MDT0000 00000001:00100000:3.0:1789127407.200165:0:7646:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789127407.200179:0:7646:0:(genops.c:885:class_export_put()) final put ffff8df682ad8800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789127407.200439:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df682ad8800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1789127407.200505:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df682adc800 for lustre-OST0001 00010000:00010000:1.0:1789127408.056317:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127409.075368:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127410.103220:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127410.163191:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6820bc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3303:1876035752779008:0@lo:400:kworker.0 00000100:00100000:1.0:1789127410.163293:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127410.163419:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752779008 00000100:00100000:3.0:1789127410.163428:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752779008 00000100:00100000:3.0:1789127410.163512:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:3.0:1789127410.163523:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df788036850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+14:3303:x1876035752779008:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789127410.163732:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789127410.163738:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789127410.163742:0:37:0:(import.c:65:import_set_state_nolock()) ffff8df681af9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789127410.163748:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 351 00000100:00080000:0.0:1789127410.164319:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789127410.164334:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8df681af9800 using connection 192.168.206.140@tcp/0@lo 00000100:00100000:0.0:1789127410.164372:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df6820bcf00 x1876035752779136/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789127410.164401:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789127410.164405:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789127410.164408:0:37:0:(import.c:65:import_set_state_nolock()) ffff8df682adb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789127410.164412:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 351 00000100:00080000:0.0:1789127410.164415:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789127410.164419:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8df682adb800 using connection 192.168.206.140@tcp/0@lo 00000100:00100000:0.0:1789127410.164446:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df6820bd2c0 x1876035752779264/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789127410.175426:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6820bcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3299:1876035752779136:0@lo:38:kworker.0 00000100:00100000:3.0:1789127410.176782:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df788036850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e+14:3303:x1876035752779008:12345-0@lo:400:kworker.0 Request processed in 13251us (13479us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127410.176812:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1789127410.178775:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127410.178878:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6820bd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3299:1876035752779264:0@lo:38:kworker.0 00000100:00100000:2.0:1789127410.178905:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127410.180267:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752779136 00000100:00100000:0.0:1789127410.180280:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752779136 00000100:00100000:0.0:1789127410.180340:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1789127410.180350:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6826a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3299:x1876035752779136:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1789127410.180373:0:5830:0:(ldlm_lib.c:1241:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1789127410.181873:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752779264 00000100:00100000:3.0:1789127410.181907:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752779264 00000100:00100000:3.0:1789127410.181956:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1789127410.181963:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6826a61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3299:x1876035752779264:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1789127410.181980:0:5831:0:(ldlm_lib.c:1241:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1789127410.182088:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6826a61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3299:x1876035752779264:12345-0@lo:38:kworker.0 Request processed in 124us (3181us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789127410.182096:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00080000:3.0:1789127410.182170:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8df682adb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789127410.182176:0:3299:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789127410.182180:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6820bd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3299:1876035752779264:0@lo:38:kworker.0 00000100:00100000:1.0:1789127410.190499:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6820bc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3303:1876035752779008:0@lo:400:kworker.0 00000100:00100000:0.0:1789127410.196862:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6826a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3299:x1876035752779136:12345-0@lo:38:kworker.0 Request processed in 16501us (18079us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789127410.196882:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00080000:2.0:1789127410.197168:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8df681af9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789127410.197175:0:3299:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789127410.197179:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6820bcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3299:1876035752779136:0@lo:38:kworker.0 00010000:00010000:1.0:1789127411.124189:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1789127411.187896:0:13368:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff8df7ae29ac60 - data ffff8df7bfe33a20/ffff8df681af4400 00000020:01000000:2.0:1789127411.188059:0:13368:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff8df7af58f2a0 - data ffff8df7a6f76a20/ffff8df7b46b6000 00000001:00000004:2.0:1789127411.204014:0:13368:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00080000:0.0:1789127411.320043:0:13368:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789127411.320057:0:13368:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:0.0:1789127411.320090:0:13368:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789127411.320094:0:13368:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1789127411.321280:0:6839:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1789127411.321290:0:6839:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:2.0:1789127411.321304:0:6839:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1789127411.323781:0:13368:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789127411.323816:0:13368:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:0.0:1789127411.323844:0:13368:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789127411.323868:0:13368:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1789127411.324630:0:8061:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1789127411.324638:0:8061:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:2.0:1789127411.324650:0:8061:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1789127411.423492:0:13368:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xeeacf7c02430012b 00000020:00000080:0.0:1789127411.423517:0:13368:0:(genops.c:885:class_export_put()) final put ffff8df7bb5f2000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789127411.424728:0:13368:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xeeacf7c024300140 00000020:00000080:0.0:1789127411.424742:0:13368:0:(genops.c:885:class_export_put()) final put ffff8df7bbde0800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1789127411.424750:0:13368:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1789127411.424762:0:13368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789127411.424772:0:13368:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789127411.424777:0:13368:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff8df7907fb490) has no exports 00000004:01000000:0.0:1789127411.424982:0:13368:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1789127411.424992:0:13368:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xeeacf7c02430037e 00000020:00000080:0.0:1789127411.424996:0:13368:0:(genops.c:885:class_export_put()) final put ffff8df7903a4000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1789127411.425000:0:13368:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1789127411.425004:0:13368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789127411.425011:0:13368:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789127411.425013:0:13368:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff8df790d39a48) has no exports 00000020:00000080:0.0:1789127411.425020:0:13368:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xeeacf7c024300377 00000020:00000080:0.0:1789127411.425023:0:13368:0:(genops.c:885:class_export_put()) final put ffff8df7af45f000/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1789127411.425381:0:13368:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1789127411.425386:0:13368:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789127411.425391:0:13368:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:0.0:1789127411.425398:0:13368:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789127411.425401:0:13368:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789127411.425448:0:13368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789127411.425454:0:13368:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789127411.425461:0:13368:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xeeacf7c024300297 00000020:00000080:2.0:1789127411.425595:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df7bb5f2000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1789127411.425611:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df7bbde0800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:2.0:1789127411.425615:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df7903a4000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1789127411.425620:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df7af45f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1789127411.425624:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df7ae060000 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1789127411.425631:0:37:0:(genops.c:885:class_export_put()) final put ffff8df682b88800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789127411.425633:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df682b88800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1789127411.425637:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789127411.425907:0:13368:0:(genops.c:885:class_export_put()) final put ffff8df681af9000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1789127411.425945:0:13368:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1789127411.425950:0:13368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789127411.425955:0:13368:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789127411.425959:0:13368:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8df790234ed8) has no exports 00000020:00000080:0.0:1789127411.425964:0:13368:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xeeacf7c024300290 00000020:00000080:0.0:1789127411.425967:0:13368:0:(genops.c:885:class_export_put()) final put ffff8df7af45e000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789127411.426317:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df681af9000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1789127411.426638:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df7af45e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1789127411.426953:0:13368:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1789127411.426957:0:13368:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789127411.426961:0:13368:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:0.0:1789127411.426966:0:13368:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789127411.426969:0:13368:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789127411.427062:0:13368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789127411.427069:0:13368:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789127411.427099:0:13368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789127411.427102:0:13368:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789127411.427106:0:13368:0:(genops.c:885:class_export_put()) final put ffff8df7bb5f6800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789127411.427109:0:13368:0:(genops.c:844:class_export_destroy()) destroying export ffff8df7bb5f6800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1789127411.427117:0:13368:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789127411.427281:0:13368:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xeeacf7c024300147 00000020:00000080:0.0:1789127411.427286:0:13368:0:(genops.c:885:class_export_put()) final put ffff8df7bbde4000/lustre-MDD0000_UUID 00000020:00000080:1.0:1789127411.427535:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df7af45d000 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1789127411.427543:0:37:0:(genops.c:885:class_export_put()) final put ffff8df681ad2000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789127411.427546:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df681ad2000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1789127411.427553:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1789127411.428098:0:13368:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1789127411.428107:0:13368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789127411.428114:0:13368:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789127411.428118:0:13368:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff8df7907f8000) has no exports 00000020:00000080:0.0:1789127411.428146:0:13368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789127411.428150:0:13368:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1789127411.428155:0:13368:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xeeacf7c02430014e 00000020:00000080:0.0:1789127411.428161:0:13368:0:(genops.c:885:class_export_put()) final put ffff8df7bbde2000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1789127411.428172:0:13368:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8df788820800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1789127411.428175:0:13368:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8df788820800 3 00000020:01000004:0.0:1789127411.428178:0:13368:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8df788820800 from lustre-MDT0000 00000020:00000080:0.0:1789127411.428199:0:13368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789127411.428203:0:13368:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1789127411.428205:0:13368:0:(genops.c:885:class_export_put()) final put ffff8df7bb5f1000/lustre-MDT0000_UUID 00000020:00000080:0.0:1789127411.428208:0:13368:0:(genops.c:844:class_export_destroy()) destroying export ffff8df7bb5f1000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1789127411.428220:0:13368:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1789127411.428255:0:13368:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:0.0:1789127411.428259:0:13368:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1789127411.428274:0:13368:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1789127411.428277:0:13368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789127411.428280:0:13368:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789127411.428287:0:13368:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8df787a1c000 c7954fd6-d5aa-44a8-939c-a8f1c4c7519e 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789127411.428292:0:13368:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff8df790d3ced8) has exports, disconnecting them 00000020:00080000:0.0:1789127411.428297:0:13368:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8df787a1c000), last request at 1789127175 00000020:00000080:0.0:1789127411.428316:0:13368:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xeeacf7c0243000ec 00000020:00010000:0.0:1789127411.428320:0:13368:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8df787a1c000: total 2 00000100:00080000:0.0:1789127411.428324:0:13368:0:(import.c:65:import_set_state_nolock()) ffff8df787a19000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1789127411.428380:0:13368:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8df787a1c000): rc 0 00000020:00080000:0.0:1789127411.428385:0:13368:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff8df790d3ced8) has no exports 00000100:00100000:0.0:1789127411.428460:0:5824:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8df790284400:5824] 1 exiting: rc = 0 00000020:00000080:1.0:1789127411.428563:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df7bbde4000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1789127411.428568:0:37:0:(genops.c:885:class_export_put()) final put ffff8df7bbde6000/lustre-MDD0000_UUID 00000020:00000080:1.0:1789127411.428570:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df7bbde6000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1789127411.428584:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1789127411.428777:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df7bbde2000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:0.0:1789127411.429122:0:5825:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8df790df1000:5825] 2 exiting: rc = 0 00000020:00010000:2.0:1789127411.429206:0:8511:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8df787a1c000: total 0 00010000:00010000:2.0:1789127411.429241:0:8511:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8df787a1c000, canceled 0 locks, left on hash table 8. 00010000:00010000:2.0:1789127411.429277:0:8511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df7ae728200/0xeeacf7c02430068e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xeeacf7c024300687 expref: 9 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127411.429293:0:8511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df780030000/0xeeacf7c024300204 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xeeacf7c0243001fd expref: 8 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127411.429309:0:8511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df7c2173200/0xeeacf7c024300680 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xeeacf7c024300679 expref: 7 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127411.429323:0:8511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df7ae728800/0xeeacf7c024300450 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xeeacf7c024300449 expref: 6 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127411.429334:0:8511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df798df1600/0xeeacf7c02430040a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xeeacf7c024300403 expref: 5 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127411.429344:0:8511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df79032cc00/0xeeacf7c0243003fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xeeacf7c0243003f5 expref: 4 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127411.429356:0:8511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df780030e00/0xeeacf7c024300418 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xeeacf7c024300411 expref: 3 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127411.429365:0:8511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df798df0a00/0xeeacf7c024300426 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xeeacf7c02430041f expref: 2 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127411.429380:0:8511:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8df787a1c000, canceled 8 locks, left on hash table 0. 00000020:00000080:2.0:1789127411.429392:0:8511:0:(genops.c:885:class_export_put()) final put ffff8df787a1c000/c7954fd6-d5aa-44a8-939c-a8f1c4c7519e 00010000:00010000:2.0:1789127411.429413:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789127411.429591:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df787a1c000/c7954fd6-d5aa-44a8-939c-a8f1c4c7519e for MGS 00000020:00000080:1.0:1789127411.429632:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df787a19000 for MGS 00010000:00010000:2.0:1789127411.429747:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127411.429749:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127411.429873:0:5822:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8df790df0c00:5822] 0 exiting: rc = 1 00000100:00100000:1.0:1789127411.429999:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127411.430009:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127411.430016:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127411.430022:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127411.430028:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127411.430038:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127411.430043:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127411.430049:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127411.430056:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127411.430074:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127411.430081:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127411.430087:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127411.430094:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127411.430100:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127411.430107:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127411.430113:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127411.430118:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127411.430124:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127411.430129:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127411.430136:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127411.430142:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127411.430149:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127411.430156:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127411.430162:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127411.430167:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127411.430174:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127411.430179:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127411.430184:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127411.430189:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127411.430195:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127411.430199:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127411.430204:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127411.430209:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127411.430215:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127411.430220:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127411.430225:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127411.430230:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127411.430236:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127411.430241:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127411.430247:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127411.430252:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127411.430258:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127411.430264:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127411.430269:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127411.430283:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127411.430289:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127411.430295:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127411.430300:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127411.430305:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127411.430311:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127411.430317:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127411.430323:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127411.430329:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127411.430335:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127411.430342:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127411.430348:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127411.430355:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127411.430362:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127411.430368:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127411.430374:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127411.430380:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127411.430386:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127411.430391:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127411.430406:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:1.0:1789127411.431212:0:13368:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789127411.431219:0:13368:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:1.0:1789127411.432817:0:13368:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff8df78813c360 - data ffff8df7bfee95e8/ffff8df682bf3400 00000020:01000000:1.0:1789127411.432961:0:13368:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff8df7986dfc00 - data ffff8df7a6f77ca8/ffff8df788169000 00000020:00000080:1.0:1789127411.433678:0:13368:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xeeacf7c0243000d0 00000020:00000080:1.0:1789127411.433689:0:13368:0:(genops.c:885:class_export_put()) final put ffff8df79843f000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1789127411.433746:0:13368:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8df788820800 from MGS, refs=2 00000020:01000004:1.0:1789127411.433751:0:13368:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8df788820800 2 00000020:01000004:1.0:1789127411.433754:0:13368:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8df788820800 from MGS 00000020:00000080:1.0:1789127411.433783:0:13368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789127411.433808:0:13368:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1789127411.433812:0:13368:0:(genops.c:885:class_export_put()) final put ffff8df79843f800/MGS 00000020:00000080:1.0:1789127411.433815:0:13368:0:(genops.c:844:class_export_destroy()) destroying export ffff8df79843f800/MGS for MGS 00000020:01000000:1.0:1789127411.433822:0:13368:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1789127411.433892:0:13368:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1789127411.433910:0:13368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789127411.433916:0:13368:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789127411.433924:0:13368:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8df7985cd800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789127411.433931:0:13368:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff8df7af70b490) has exports, disconnecting them 00000020:00080000:1.0:1789127411.433936:0:13368:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8df7985cd800), last request at 1789127176 00000020:00000080:1.0:1789127411.433940:0:13368:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xeeacf7c02430019b 00000020:00080000:1.0:1789127411.433951:0:13368:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8df7985cd800): rc 0 00000020:00000080:1.0:1789127411.433957:0:13368:0:(genops.c:885:class_export_put()) final put ffff8df7985cd800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1789127411.437501:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8df79843f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789127411.438753:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8df7985cd800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1789127411.438829:0:13368:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1789127411.438835:0:13368:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789127411.438840:0:13368:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789127411.438847:0:13368:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789127411.438872:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df7bb584000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1789127411.439065:0:13368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789127411.439074:0:13368:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1789127411.439081:0:13368:0:(genops.c:885:class_export_put()) final put ffff8df7bb587000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1789127411.439084:0:13368:0:(genops.c:844:class_export_destroy()) destroying export ffff8df7bb587000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1789127411.439092:0:13368:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1789127411.439170:0:13368:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8df788820800 1 00000020:00000080:0.0:1789127411.439176:0:13368:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xeeacf7c0243000c2 00000020:00000080:0.0:1789127411.439183:0:13368:0:(genops.c:885:class_export_put()) final put ffff8df798438800/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1789127411.439203:0:13368:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1789127411.439211:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8df798438800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789127411.439221:0:13368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789127411.439226:0:13368:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789127411.439230:0:13368:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff8df790d3b490) has no exports 00000020:00000080:2.0:1789127411.459894:0:13368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789127411.459915:0:13368:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1789127411.459922:0:13368:0:(genops.c:885:class_export_put()) final put ffff8df786187000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789127411.459928:0:13368:0:(genops.c:844:class_export_destroy()) destroying export ffff8df786187000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1789127411.459947:0:13368:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1789127411.460137:0:13368:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8df788822800 00000020:01000000:2.0:1789127411.460169:0:13368:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1789127411.460173:0:13368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789127411.460179:0:13368:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789127411.460184:0:13368:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff8df7881d9a48) has no exports 00000100:00100000:2.0:1789127411.460275:0:10285:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff8df6813aee00:10285] 3 exiting: rc = 0 00000100:00100000:2.0:1789127411.460398:0:5832:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff8df7a0291400:5832] 2 exiting: rc = 0 00000100:00100000:3.0:1789127411.461711:0:5831:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff8df79021fa00:5831] 1 exiting: rc = 0 00000100:00100000:0.0:1789127411.468385:0:5830:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff8df7a0290a00:5830] 0 exiting: rc = 1 00000100:00100000:0.0:1789127411.469294:0:12098:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff8df788313a00:12098] 4 exiting: rc = 0 00000100:00100000:2.0:1789127411.471773:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.471783:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.471790:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.471799:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.471807:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.471813:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.471820:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.471840:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.471846:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.471852:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.471858:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.471864:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.471870:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.471876:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.471881:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.471887:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.471892:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.471898:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.471904:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.471909:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.471928:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.471934:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.471940:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.471946:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.471951:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.471957:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.471963:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.471968:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.471973:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.471978:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.471984:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.471990:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.471995:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.472001:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.472007:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.472053:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.472059:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.472065:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.472071:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.472076:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.472153:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.472164:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.472169:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.472177:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.472184:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.472190:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.472196:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.472203:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.472212:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.472218:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.472224:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.472230:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.472236:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.472242:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.472248:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.472260:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.472266:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.472272:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.472278:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.472284:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.472290:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.472297:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.472303:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.472309:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127411.479305:0:5833:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8df7902f4e00:5833] 0 exiting: rc = 1 00000100:00100000:0.0:1789127411.479305:0:5834:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8df78ef90a00:5834] 1 exiting: rc = 0 00000100:00100000:2.0:1789127411.480103:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.480114:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.480121:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.480127:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.480134:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.480141:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.480148:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.480160:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.480168:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.480177:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.480185:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.480193:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.480217:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.480226:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.480235:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.480244:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.480251:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.480259:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.480267:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.480274:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.480281:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.480289:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.480298:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.480308:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.480318:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.480323:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.480346:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.480351:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.480357:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.480379:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.480388:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.480394:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.480400:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.480406:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.480411:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.480641:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.480651:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.480657:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.480662:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.480668:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.480674:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.480680:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.480686:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.480692:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.480697:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.480703:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.480709:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.480715:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.480721:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.480726:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.480732:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.480738:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.480743:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.480748:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.480754:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.480759:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.480764:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.480770:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.480780:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.480813:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.480819:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.480835:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.480840:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.480846:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127411.482943:0:5836:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff8df7902f5a00:5836] 1 exiting: rc = 0 00000100:00100000:1.0:1789127411.482943:0:5835:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff8df7902f5c00:5835] 0 exiting: rc = 1 00000100:00100000:2.0:1789127411.483314:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.483323:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.483331:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.483342:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.483351:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.483360:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.483380:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.483389:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.483398:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.483406:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.483416:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.483424:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.483767:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.483773:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.483784:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.483819:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.483826:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.483838:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.483870:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.483879:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.483887:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.483898:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.483907:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.483915:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.483924:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.483939:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.483949:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.483957:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.483965:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.483974:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.484009:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.484022:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.484045:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.484053:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.484059:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.484066:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.484072:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.484079:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.484086:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.484093:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.484103:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.484109:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.484142:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.484156:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.484169:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.484179:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.484186:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.484194:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.484207:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.484213:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.484221:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.484227:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.484234:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.484244:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.484267:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.484281:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.484298:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.484304:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.484311:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.484318:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.484324:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.484331:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.484338:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.484351:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.510839:0:5838:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8df78777cc00:5838] 1 exiting: rc = 0 00000100:00100000:2.0:1789127411.511884:0:5837:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8df7881fa800:5837] 0 exiting: rc = 1 00000100:00100000:0.0:1789127411.512154:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.512163:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.512169:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.512177:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.512183:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.512189:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.512195:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.512205:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.512212:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.512218:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.512224:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.512230:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.512235:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.512241:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.512248:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.512253:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.512259:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.512265:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.512272:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.512277:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.512282:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.512288:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.512294:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.512299:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.512330:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.512336:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.512341:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.512345:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.512350:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.512355:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.512360:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.512365:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.512370:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.512375:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.512383:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.512389:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.512394:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.512400:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.512405:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.512410:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.512415:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.512420:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.512426:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.512432:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.512438:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.512444:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.512449:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.512455:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.512460:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.512465:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.512471:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.512477:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.512483:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.512489:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.512505:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.512511:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.512516:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.512522:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.512527:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.512551:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.512556:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.512562:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.512568:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.512573:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.513078:0:5839:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8df7881fa200:5839] 0 exiting: rc = 1 00000100:00100000:2.0:1789127411.513095:0:5840:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8df78ef91800:5840] 1 exiting: rc = 0 00000100:00100000:0.0:1789127411.513179:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.513187:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.513193:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.513202:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.513211:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.513300:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.513307:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.513312:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.513323:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.513329:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.513335:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.513340:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.513356:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.513361:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.513367:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.513373:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.513379:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.513384:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.513390:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.513395:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.513401:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.513407:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.513413:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.513419:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.513424:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.513430:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.513435:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.513441:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.513447:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.513466:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.513472:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.513477:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.513483:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.513488:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.513503:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.513509:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.513515:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.513521:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.513527:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.513532:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.513538:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.513543:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.513550:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.513555:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.513561:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.513567:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.513572:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.513579:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.513584:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.513590:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.513595:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.513600:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.513606:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.513612:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.513617:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.513622:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.513627:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.513632:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.513638:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.513643:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.513648:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.513653:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.513658:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.513973:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.514407:0:5841:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff8df787778000:5841] 0 exiting: rc = 1 00000100:00100000:2.0:1789127411.514609:0:5842:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff8df7984bcc00:5842] 1 exiting: rc = 0 00000100:00100000:0.0:1789127411.516879:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.516890:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.516896:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.516902:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.516908:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.516913:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.516920:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.516926:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.516932:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.516937:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.516943:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.516949:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.516956:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.516962:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.516968:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.516974:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.516979:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.516985:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.516991:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.516996:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.517015:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.517022:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.517027:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.517033:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.517038:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.517043:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.517048:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.517053:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.517058:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.517063:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.517069:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.517075:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.517080:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.517086:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.517116:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.517122:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.517128:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.517134:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.517139:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.517144:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.517150:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.517155:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.517162:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.517167:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.517173:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.517178:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.517184:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.517188:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.517193:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.517199:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.517204:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.517209:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.517214:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.517220:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.517225:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.517230:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.517237:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.517244:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.517586:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.517597:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.517603:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.517609:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.517615:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.517621:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127411.518832:0:5843:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff8df787779e00:5843] 0 exiting: rc = 1 00000100:00100000:0.0:1789127411.518940:0:5844:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff8df7984bc800:5844] 1 exiting: rc = 0 00000100:00100000:0.0:1789127411.519707:0:5845:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff8df787774800:5845] 2 exiting: rc = 0 00000100:00100000:0.0:1789127411.519824:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.519833:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.519872:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.519903:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.519909:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.519916:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.519923:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.519929:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.519935:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.519942:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.519948:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.519959:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.519966:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.519972:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.519979:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.519985:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.519991:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.519997:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.520004:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.520011:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.520018:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.520025:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.520075:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.520084:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.520090:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.520099:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.520119:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.520127:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.520133:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.520139:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.520146:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.520152:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.520158:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.520164:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.520171:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.520178:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.520184:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.520191:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.520206:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.520212:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.520218:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.520224:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.520230:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.520237:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.520252:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.520262:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.520269:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.520278:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.520285:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.520292:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.520312:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.520320:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.520326:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.520331:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.520337:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.520450:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.520459:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.520466:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.520481:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.520488:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.520504:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.520511:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.520517:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127411.520524:0:13368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1789127411.547265:0:13368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789127411.547284:0:13368:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1789127411.547290:0:13368:0:(genops.c:885:class_export_put()) final put ffff8df78729b800/MDS_uuid 00000020:00000080:0.0:1789127411.547296:0:13368:0:(genops.c:844:class_export_destroy()) destroying export ffff8df78729b800/MDS_uuid for MDS 00000020:01000000:0.0:1789127411.547305:0:13368:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1789127411.547580:0:13368:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1789127412.147103:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127413.172702:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127414.197572:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127415.220142:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789127415.264686:0:13524:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1789127415.280243:0:13524:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1789127415.280301:0:13524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df7bbd97000/0xeeacf7c024300411 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c024300418 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127415.280317:0:13524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df7bbd97000/0xeeacf7c024300411 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xeeacf7c024300418 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127415.280325:0:13524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df7bbd97000/0xeeacf7c024300411 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xeeacf7c024300418 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127415.280333:0:13524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.140@tcp lock: ffff8df7bbd97000/0xeeacf7c024300411 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xeeacf7c024300418 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127415.280355:0:13524:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789127415.280360:0:13524:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:1.0:1789127415.280391:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789127415.280398:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.140@tcp lock: ffff8df7bbd97000/0xeeacf7c024300411 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xeeacf7c024300418 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127415.280430:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd97000 already unused, calling callback (ffffffffc1da1c20) 10000000:00010000:1.0:1789127415.280434:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.140@tcp lock: ffff8df7bbd97000/0xeeacf7c024300411 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xeeacf7c024300418 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127415.280442:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: ffff8df7bbd97000/0xeeacf7c024300411 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xeeacf7c024300418 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789127415.280450:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: ffff8df7bbd97000/0xeeacf7c024300411 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xeeacf7c024300418 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789127415.280456:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789127415.280459:0:5818:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1789127415.280461:0:5818:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1789127415.280516:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.140@tcp lock: ffff8df7bbd97000/0xeeacf7c024300411 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xeeacf7c024300418 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127415.280523:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789127415.280548:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.140@tcp lock: ffff8df7bbd97000/0xeeacf7c024300411 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xeeacf7c024300418 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127415.280556:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: ffff8df7bbd97000/0xeeacf7c024300411 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xeeacf7c024300418 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127415.280568:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127415.280570:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127415.280572:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127415.280594:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae2f83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3300:1876035752779392:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789127415.280676:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127415.280763:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752779392 00000100:00100000:1.0:1789127415.280777:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752779392 00000100:00100000:1.0:1789127415.280853:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789127415.280861:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae2f8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3300:x1876035752779392:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1789127415.280868:0:5815:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789127415 with bad export cookie 17198393481633988844 00000100:00080000:0.0:1789127415.282283:0:13524:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789127415.282293:0:13524:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789127415.282302:0:13524:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789127415.282322:0:13524:0:(import.c:65:import_set_state_nolock()) ffff8df681af9800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1789127415.282329:0:13524:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789127415.282332:0:13524:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789127415.282335:0:13524:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1789127415.283285:0:13524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df79032c600/0xeeacf7c02430041f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c024300426 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127415.283304:0:13524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df79032c600/0xeeacf7c02430041f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xeeacf7c024300426 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127415.283311:0:13524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df79032c600/0xeeacf7c02430041f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xeeacf7c024300426 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127415.283318:0:13524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.140@tcp lock: ffff8df79032c600/0xeeacf7c02430041f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xeeacf7c024300426 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127415.283348:0:13524:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789127415.283357:0:13524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df79032c000/0xeeacf7c024300687 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c02430068e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127415.283364:0:13524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df79032c000/0xeeacf7c024300687 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xeeacf7c02430068e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127415.283369:0:13524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df79032c000/0xeeacf7c024300687 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xeeacf7c02430068e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127415.283375:0:13524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.140@tcp lock: ffff8df79032c000/0xeeacf7c024300687 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xeeacf7c02430068e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127415.283393:0:13524:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1789127415.283409:0:13524:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1789127415.283441:0:13524:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1789127415.283447:0:13524:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1789127415.283454:0:13524:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789127415.283460:0:13524:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789127415.283465:0:13524:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8df7881dced8) has no exports 00000020:00080000:0.0:1789127415.283720:0:13524:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8df7881dced8) has no exports 00010000:00010000:3.0:1789127415.286571:0:8511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789127415.286589:0:8511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.140@tcp lock: ffff8df79032c600/0xeeacf7c02430041f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xeeacf7c024300426 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127415.286604:0:8511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df79032c600 already unused, calling callback (ffffffffc1da1c20) 10000000:00010000:3.0:1789127415.286609:0:8511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.140@tcp lock: ffff8df79032c600/0xeeacf7c02430041f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xeeacf7c024300426 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127415.286624:0:8511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: ffff8df79032c600/0xeeacf7c02430041f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xeeacf7c024300426 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789127415.286632:0:8511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: ffff8df79032c600/0xeeacf7c02430041f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xeeacf7c024300426 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127415.286638:0:8511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789127415.286641:0:8511:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:3.0:1789127415.286671:0:8511:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:3.0:1789127415.286736:0:8511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.140@tcp lock: ffff8df79032c600/0xeeacf7c02430041f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xeeacf7c024300426 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127415.286743:0:8511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789127415.286784:0:8511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.140@tcp lock: ffff8df79032c600/0xeeacf7c02430041f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xeeacf7c024300426 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127415.286812:0:8511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: ffff8df79032c600/0xeeacf7c02430041f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xeeacf7c024300426 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127415.286831:0:8511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789127415.286835:0:8511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.140@tcp lock: ffff8df79032c000/0xeeacf7c024300687 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xeeacf7c02430068e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127415.286842:0:8511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df79032c000 already unused, calling callback (ffffffffc1da1c20) 10000000:00010000:3.0:1789127415.286845:0:8511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.140@tcp lock: ffff8df79032c000/0xeeacf7c024300687 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xeeacf7c02430068e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127415.286853:0:8511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: ffff8df79032c000/0xeeacf7c024300687 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xeeacf7c02430068e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789127415.286860:0:8511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: ffff8df79032c000/0xeeacf7c024300687 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xeeacf7c02430068e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127415.286866:0:8511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1789127415.286868:0:8511:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1789127415.286870:0:8511:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1789127415.286882:0:8511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.140@tcp lock: ffff8df79032c000/0xeeacf7c024300687 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xeeacf7c02430068e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127415.286888:0:8511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789127415.286918:0:8511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.140@tcp lock: ffff8df79032c000/0xeeacf7c024300687 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xeeacf7c02430068e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127415.286925:0:8511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: ffff8df79032c000/0xeeacf7c024300687 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xeeacf7c02430068e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127415.286934:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127415.286936:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127415.286937:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127415.286948:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789127415.286969:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae040000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3303:1876035752779648:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789127415.287050:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127415.287111:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752779648 00000100:00100000:3.0:1789127415.287119:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752779648 00000100:00100000:3.0:1789127415.287160:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789127415.287167:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae042940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3303:x1876035752779648:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1789127415.287174:0:5817:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789127415 with bad export cookie 17198393481633988844 00000100:00100000:3.0:1789127415.287219:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae042940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3303:x1876035752779648:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (168us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789127415.287227:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789127415.287252:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae040780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3301:1876035752779520:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789127415.287273:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127415.287300:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752779520 00000100:00100000:3.0:1789127415.287304:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752779520 00000100:00100000:3.0:1789127415.287320:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789127415.287324:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae043c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3301:x1876035752779520:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1789127415.287329:0:5816:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789127415 with bad export cookie 17198393481633988844 00000100:00100000:3.0:1789127415.287355:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae043c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3301:x1876035752779520:12345-0@lo:103:ldlm_bl.0 Request processed in 30us (81us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789127415.287367:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1789127415.287401:0:3301:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.140@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1789127415.287406:0:3301:0:(import.c:65:import_set_state_nolock()) ffff8df787a1a000 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1789127415.287410:0:3301:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.206.140@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000020:01000000:0.0:1789127415.293122:0:13524:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff8df7b4b4d9c0 - data ffff8df7a66561b0/ffff8df7af586000 00000020:01000000:0.0:1789127415.293328:0:13524:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff8df790dd1600 - data ffff8df7a6443af8/ffff8df681882c00 00000100:00080000:2.0:1789127415.294925:0:3303:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.140@tcp of MGS@0@lo abruptly disconnected: reconnecting 00010000:00010000:1.0:1789127415.296411:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127415.296689:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae2f8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3300:x1876035752779392:12345-0@lo:103:ldlm_bl.0 Request processed in 15821us (16006us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789127415.296703:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1789127415.306554:0:3301:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.206.140@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1789127415.306561:0:3301:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1789127415.306575:0:3301:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8df7ae2f83c0 x1876035752779392/t0(0) o103->MGC192.168.206.140@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789127431 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127415.306594:0:3301:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8df7ae040000 x1876035752779648/t0(0) o103->MGC192.168.206.140@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789127431 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127415.306605:0:3301:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8df7ae040780 x1876035752779520/t0(0) o103->MGC192.168.206.140@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789127431 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1789127415.306621:0:3301:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1789127415.306625:0:3301:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1789127415.306627:0:3301:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1789127415.306634:0:3301:0:(import.c:65:import_set_state_nolock()) ffff8df787a1a000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789127415.306634:0:3303:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8df787a1a000 already not connected (conn 1, was 1): DISCONN 00000100:00080000:3.0:1789127415.306641:0:3301:0:(import.c:510:import_select_connection()) MGC192.168.206.140@tcp: connect to NID 0@lo last attempt 121 00000100:00080000:3.0:1789127415.306653:0:3301:0:(import.c:624:import_select_connection()) MGC192.168.206.140@tcp: import ffff8df787a1a000 using connection 192.168.206.140@tcp/0@lo 00000100:00100000:2.0:1789127415.306666:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae040000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3303:1876035752779648:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1789127415.306886:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789127415.306892:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789127415.306895:0:37:0:(import.c:65:import_set_state_nolock()) ffff8df682adb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789127415.306899:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 356 00000100:00080000:1.0:1789127415.306904:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789127415.306908:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8df682adb800 using connection 192.168.206.140@tcp/0@lo 00000100:00100000:3.0:1789127415.307037:0:3301:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df7ae040f00 x1876035752779776/t0(0) o250->MGC192.168.206.140@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789127415.307078:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae040f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3299:1876035752779776:0@lo:250:ptlrpcd_00_01.0 00000100:00100000:2.0:1789127415.307078:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae2f83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3300:1876035752779392:0@lo:103:ldlm_bl.0 00000400:00000100:3.0:1789127415.307143:0:3299:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876035752779776 offset 0 length 520: 4 00000100:00100000:3.0:1789127415.307197:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae040780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3301:1876035752779520:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789127415.307272:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df6820bde00 x1876035752779904/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789127415.307340:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6820bde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3299:1876035752779904:0@lo:38:kworker.0 00000400:00000100:3.0:1789127415.307366:0:3299:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876035752779904 offset 0 length 520: 4 00100000:10000000:0.0:1789127415.320229:0:13524:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1789127415.389900:0:13524:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xeeacf7c024300220 00000020:00000080:2.0:1789127415.389917:0:13524:0:(genops.c:885:class_export_put()) final put ffff8df6811a4000/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1789127415.389939:0:13524:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8df788896800 from lustre-OST0000, refs=2 00000020:01000004:2.0:1789127415.389944:0:13524:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8df788896800 2 00000020:01000004:2.0:1789127415.389947:0:13524:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8df788896800 from lustre-OST0000 00000020:00000080:2.0:1789127415.389979:0:13524:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789127415.389992:0:13524:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1789127415.389995:0:13524:0:(genops.c:885:class_export_put()) final put ffff8df6811a0000/lustre-OST0000_UUID 00000020:00000080:2.0:1789127415.389999:0:13524:0:(genops.c:844:class_export_destroy()) destroying export ffff8df6811a0000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1789127415.390007:0:13524:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1789127415.390060:0:13524:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1789127415.390066:0:13524:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1789127415.390071:0:13524:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789127415.390076:0:13524:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789127415.390084:0:13524:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8df681af8000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789127415.390091:0:13524:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff8df7af70ced8) has exports, disconnecting them 00000020:00080000:2.0:1789127415.390097:0:13524:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8df681af8000), last request at 1789127192 00000020:00000080:2.0:1789127415.390101:0:13524:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xeeacf7c02430024a 00000020:00080000:2.0:1789127415.390112:0:13524:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8df681af8000): rc 0 00000020:00000080:2.0:1789127415.390117:0:13524:0:(genops.c:885:class_export_put()) final put ffff8df681af8000/lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1789127415.390748:0:13524:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1789127415.390755:0:13524:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789127415.390777:0:13524:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789127415.390785:0:13524:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789127415.391015:0:13524:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789127415.391021:0:13524:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:2.0:1789127415.391027:0:13524:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8df788896800 1 00000020:00000080:2.0:1789127415.391032:0:13524:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xeeacf7c0243001da 00000020:00000080:2.0:1789127415.391038:0:13524:0:(genops.c:885:class_export_put()) final put ffff8df7bb5d6000/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1789127415.391043:0:13524:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1789127415.391048:0:13524:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789127415.391051:0:13524:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789127415.391054:0:13524:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff8df790233490) has no exports 00000020:00000080:3.0:1789127415.392077:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df6811a4000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1789127415.392100:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df681af8000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1789127415.392107:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df681af9800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1789127415.392116:0:37:0:(genops.c:885:class_export_put()) final put ffff8df79037f000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1789127415.392119:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df79037f000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1789127415.392124:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1789127415.392191:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df7bb5d6000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1789127415.435507:0:13524:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789127415.435529:0:13524:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1789127415.435536:0:13524:0:(genops.c:885:class_export_put()) final put ffff8df788894800/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1789127415.435543:0:13524:0:(genops.c:844:class_export_destroy()) destroying export ffff8df788894800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1789127415.435552:0:13524:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1789127415.435761:0:13524:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8df788893000 00000020:02000400:1.0:1789127415.435848:0:13524:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1789127416.249917:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127417.267903:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789127418.270420:0:13676:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1789127418.287984:0:13676:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1789127418.288064:0:13676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df780031600/0xeeacf7c0243003f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c0243003fc expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127418.288077:0:13676:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df780031600/0xeeacf7c0243003f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xeeacf7c0243003fc expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127418.288084:0:13676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df780031600/0xeeacf7c0243003f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xeeacf7c0243003fc expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127418.288091:0:13676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.140@tcp lock: ffff8df780031600/0xeeacf7c0243003f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xeeacf7c0243003fc expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127418.288117:0:13676:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789127418.288123:0:13676:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1789127418.288154:0:13676:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789127418.288175:0:13676:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8df6820bde00 x1876035752779904/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789127435 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127418.288191:0:13676:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789127418.288207:0:13676:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789127418.288213:0:13676:0:(import.c:65:import_set_state_nolock()) ffff8df682adb800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1789127418.288218:0:13676:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789127418.288222:0:13676:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8df6820bde00 x1876035752779904/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789127435 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127418.288230:0:13676:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789127418.288233:0:13676:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 22s for inflight to error out 00000100:00100000:3.0:1789127418.288629:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6820bde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3299:1876035752779904:0@lo:38:kworker.0 00010000:00010000:2.0:1789127418.289547:0:13676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df7bbd96c00/0xeeacf7c024300403 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c02430040a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127418.289561:0:13676:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df7bbd96c00/0xeeacf7c024300403 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xeeacf7c02430040a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127418.289567:0:13676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df7bbd96c00/0xeeacf7c024300403 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xeeacf7c02430040a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127418.289573:0:13676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.140@tcp lock: ffff8df7bbd96c00/0xeeacf7c024300403 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xeeacf7c02430040a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127418.289590:0:13676:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789127418.289596:0:13676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df79032de00/0xeeacf7c024300679 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c024300680 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127418.289602:0:13676:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df79032de00/0xeeacf7c024300679 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xeeacf7c024300680 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127418.289607:0:13676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df79032de00/0xeeacf7c024300679 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xeeacf7c024300680 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127418.289612:0:13676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.140@tcp lock: ffff8df79032de00/0xeeacf7c024300679 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xeeacf7c024300680 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127418.289638:0:13676:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:2.0:1789127418.289643:0:13676:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1789127418.289660:0:13676:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1789127418.289665:0:13676:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1789127418.289669:0:13676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789127418.289674:0:13676:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789127418.289678:0:13676:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8df7af709a48) has no exports 00000020:00080000:2.0:1789127418.289888:0:13676:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8df7af709a48) has no exports 00010000:00010000:3.0:1789127418.291609:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789127418.291620:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.140@tcp lock: ffff8df780031600/0xeeacf7c0243003f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xeeacf7c0243003fc expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127418.291630:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df780031600 already unused, calling callback (ffffffffc1da1c20) 10000000:00010000:3.0:1789127418.291635:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.140@tcp lock: ffff8df780031600/0xeeacf7c0243003f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xeeacf7c0243003fc expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127418.291645:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: ffff8df780031600/0xeeacf7c0243003f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xeeacf7c0243003fc expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789127418.291653:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: ffff8df780031600/0xeeacf7c0243003f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xeeacf7c0243003fc expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127418.291659:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789127418.291661:0:5818:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1789127418.291663:0:5818:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1789127418.291678:0:5818:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8df787a1a000 00010000:00010000:3.0:1789127418.291681:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.140@tcp lock: ffff8df780031600/0xeeacf7c0243003f5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xeeacf7c0243003fc expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127418.291705:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: ffff8df780031600/0xeeacf7c0243003f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xeeacf7c0243003fc expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127418.291719:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789127418.291723:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.140@tcp lock: ffff8df7bbd96c00/0xeeacf7c024300403 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xeeacf7c02430040a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127418.291729:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd96c00 already unused, calling callback (ffffffffc1da1c20) 10000000:00010000:3.0:1789127418.291732:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.140@tcp lock: ffff8df7bbd96c00/0xeeacf7c024300403 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xeeacf7c02430040a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127418.291738:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: ffff8df7bbd96c00/0xeeacf7c024300403 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xeeacf7c02430040a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789127418.291744:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: ffff8df7bbd96c00/0xeeacf7c024300403 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xeeacf7c02430040a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127418.291750:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789127418.291752:0:5818:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:3.0:1789127418.291753:0:5818:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:3.0:1789127418.291759:0:5818:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8df787a1a000 00010000:00010000:3.0:1789127418.291762:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.140@tcp lock: ffff8df7bbd96c00/0xeeacf7c024300403 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xeeacf7c02430040a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127418.291767:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: ffff8df7bbd96c00/0xeeacf7c024300403 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xeeacf7c02430040a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127418.291774:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789127418.291777:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.140@tcp lock: ffff8df79032de00/0xeeacf7c024300679 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xeeacf7c024300680 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127418.291814:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df79032de00 already unused, calling callback (ffffffffc1da1c20) 10000000:00010000:3.0:1789127418.291817:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.140@tcp lock: ffff8df79032de00/0xeeacf7c024300679 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xeeacf7c024300680 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127418.291824:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: ffff8df79032de00/0xeeacf7c024300679 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xeeacf7c024300680 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789127418.291829:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: ffff8df79032de00/0xeeacf7c024300679 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xeeacf7c024300680 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127418.291833:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1789127418.291835:0:5818:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1789127418.291837:0:5818:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1789127418.291844:0:5818:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8df787a1a000 00010000:00010000:3.0:1789127418.291846:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.140@tcp lock: ffff8df79032de00/0xeeacf7c024300679 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xeeacf7c024300680 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127418.291851:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: ffff8df79032de00/0xeeacf7c024300679 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xeeacf7c024300680 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127418.291863:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127418.291865:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127418.291866:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127418.291930:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127418.292357:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1789127418.292922:0:13676:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff8df7ae29a240 - data ffff8df7a676e288/ffff8df682b84400 00000020:01000000:3.0:1789127418.293051:0:13676:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff8df7b4b4d300 - data ffff8df7bfe3e000/ffff8df682b86c00 00010000:00010000:1.0:1789127418.293526:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:0.0:1789127418.313299:0:13676:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1789127418.355656:0:13676:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xeeacf7c0243002eb 00000020:00000080:0.0:1789127418.355665:0:13676:0:(genops.c:885:class_export_put()) final put ffff8df79037d800/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1789127418.355686:0:13676:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8df7b45fe800 from lustre-OST0001, refs=2 00000020:01000004:0.0:1789127418.355690:0:13676:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8df7b45fe800 2 00000020:01000004:0.0:1789127418.355693:0:13676:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8df7b45fe800 from lustre-OST0001 00000020:00000080:0.0:1789127418.355716:0:13676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789127418.355725:0:13676:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1789127418.355728:0:13676:0:(genops.c:885:class_export_put()) final put ffff8df681ad6800/lustre-OST0001_UUID 00000020:00000080:0.0:1789127418.355731:0:13676:0:(genops.c:844:class_export_destroy()) destroying export ffff8df681ad6800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1789127418.355738:0:13676:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1789127418.355874:0:13676:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import c7954fd6-d5aa-44a8-939c-a8f1c4c7519e->MGS 00010000:00010000:0.0:1789127418.355889:0:13676:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: ffff8df7c2050e00/0xeeacf7c0243001fd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xeeacf7c024300204 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789127418.355900:0:13676:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: ffff8df7c2050e00/0xeeacf7c0243001fd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xeeacf7c024300204 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127418.355921:0:13676:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1789127418.355924:0:13676:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1789127418.355927:0:13676:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1789127418.355940:0:13676:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8df787a1a000 00010000:00010000:0.0:1789127418.355945:0:13676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: ffff8df7c2050e00/0xeeacf7c0243001fd lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xeeacf7c024300204 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127418.355959:0:13676:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: ffff8df79032ce00/0xeeacf7c024300449 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xeeacf7c024300450 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789127418.355966:0:13676:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: ffff8df79032ce00/0xeeacf7c024300449 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xeeacf7c024300450 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127418.355971:0:13676:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789127418.355974:0:13676:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1789127418.355975:0:13676:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1789127418.355982:0:13676:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8df787a1a000 00010000:00010000:0.0:1789127418.355985:0:13676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: ffff8df79032ce00/0xeeacf7c024300449 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xeeacf7c024300450 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789127418.356000:0:13676:0:(import.c:65:import_set_state_nolock()) ffff8df787a1a000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1789127418.356004:0:13676:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1789127418.356006:0:13676:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1789127418.356008:0:13676:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1789127418.356011:0:13676:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1789127418.356020:0:13676:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8df7ae040f00 x1876035752779776/t0(0) o250->MGC192.168.206.140@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789127425 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1789127418.356038:0:13676:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1789127418.356041:0:13676:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000100:00100000:1.0:1789127418.356124:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae040f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c7954fd6-d5aa-44a8-939c-a8f1c4c7519e:3299:1876035752779776:0@lo:250:ptlrpcd_00_01.0 00000020:00000080:2.0:1789127418.356268:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8df79037d800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 10000000:01000000:0.0:1789127418.356315:0:13676:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1789127418.356327:0:13676:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xeeacf7c0243000de 00000020:00000080:0.0:1789127418.356331:0:13676:0:(genops.c:885:class_export_put()) final put ffff8df78729d000/c7954fd6-d5aa-44a8-939c-a8f1c4c7519e 00000020:01000000:0.0:1789127418.356346:0:13676:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.206.140@tcp (flags='') 00000020:00000080:0.0:1789127418.356351:0:13676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789127418.356356:0:13676:0:(obd_config.c:956:class_cleanup()) MGC192.168.206.140@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789127418.356359:0:13676:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff8df790d38000) has no exports 10000000:01000000:1.0:1789127418.356415:0:5827:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 00000020:00000080:2.0:1789127418.356531:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8df78729d000/c7954fd6-d5aa-44a8-939c-a8f1c4c7519e for MGC192.168.206.140@tcp 10000000:01000000:0.0:1789127418.356566:0:13676:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.206.140@tcp: client import never connected 00000100:00080000:0.0:1789127418.356569:0:13676:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1789127418.356571:0:13676:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1789127418.356574:0:13676:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1789127418.356575:0:13676:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1789127418.356614:0:13676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789127418.356619:0:13676:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.206.140@tcp (uuid c7954fd6-d5aa-44a8-939c-a8f1c4c7519e) 00000020:01000000:0.0:1789127418.356624:0:13676:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1789127418.356627:0:13676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789127418.356630:0:13676:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789127418.356635:0:13676:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8df682ad9000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789127418.356640:0:13676:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff8df790230000) has exports, disconnecting them 00000020:00080000:0.0:1789127418.356644:0:13676:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8df682ad9000), last request at 1789127211 00000020:00000080:0.0:1789127418.356648:0:13676:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xeeacf7c024300315 00000020:00080000:0.0:1789127418.356657:0:13676:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8df682ad9000): rc 0 00000020:00000080:0.0:1789127418.356661:0:13676:0:(genops.c:885:class_export_put()) final put ffff8df682ad9000/lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1789127418.357241:0:13676:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1789127418.357246:0:13676:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789127418.357249:0:13676:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789127418.357253:0:13676:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789127418.357363:0:13676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789127418.357368:0:13676:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:0.0:1789127418.357373:0:13676:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8df7b45fe800 1 00000020:00000080:0.0:1789127418.357377:0:13676:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xeeacf7c0243002ba 00000020:00000080:0.0:1789127418.357383:0:13676:0:(genops.c:885:class_export_put()) final put ffff8df7af45b000/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1789127418.357396:0:13676:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1789127418.357399:0:13676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789127418.357402:0:13676:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789127418.357405:0:13676:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff8df7af708000) has no exports 00000020:00000080:2.0:1789127418.357571:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df787a1a000 for MGC192.168.206.140@tcp 00000020:00000080:2.0:1789127418.357579:0:36:0:(genops.c:885:class_export_put()) final put ffff8df787a18000/c7954fd6-d5aa-44a8-939c-a8f1c4c7519e 00000020:00000080:2.0:1789127418.357582:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8df787a18000/c7954fd6-d5aa-44a8-939c-a8f1c4c7519e for MGC192.168.206.140@tcp 00000020:01000000:2.0:1789127418.357587:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.206.140@tcp (c7954fd6-d5aa-44a8-939c-a8f1c4c7519e) 00010000:00010000:1.0:1789127418.358187:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1789127418.359289:0:8511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1789127418.359370:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:1.0:1789127418.359477:0:5813:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8df791f73600:5813] 0 exiting: rc = 1 00000100:00100000:2.0:1789127418.359608:0:7634:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff8df7b47fbc00:7634] 2 exiting: rc = 0 00000100:00100000:1.0:1789127418.366898:0:5814:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8df791f73e00:5814] 1 exiting: rc = 0 00000100:00100000:1.0:1789127418.367007:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.367249:0:5815:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8df791f72a00:5815] 0 exiting: rc = 1 00000020:00000080:1.0:1789127418.372246:0:13676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789127418.372262:0:13676:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000100:00100000:2.0:1789127418.380350:0:8454:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8df7b47fa400:8454] 3 exiting: rc = 0 00000100:00100000:3.0:1789127418.380690:0:5816:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8df791f72400:5816] 1 exiting: rc = 0 00000100:00100000:3.0:1789127418.380748:0:5817:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8df790cb4a00:5817] 2 exiting: rc = 0 00000100:00100000:1.0:1789127418.380981:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.380989:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.380996:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.381004:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.381009:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.381015:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.381021:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.381028:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.381034:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.381040:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.381046:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.381052:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.381059:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.381065:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.381071:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.381077:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.381082:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.381088:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.381093:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.381098:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.381102:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.381107:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.381113:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.381118:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.381122:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.381127:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.381150:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.381155:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.381160:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.381165:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.381170:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.381175:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.381179:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.381184:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.381188:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.381193:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.381197:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.381201:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.381205:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.381210:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.381214:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.381221:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.381226:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.381230:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.381236:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.381241:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.381246:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.381251:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.381256:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.381261:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.381266:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.381271:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.381276:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.381281:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.381285:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.381289:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.381294:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.381299:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.381304:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.382709:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.382728:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.382747:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.382753:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.382758:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1789127418.387367:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8df682ad9000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1789127418.387382:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df682adb800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1789127418.387388:0:36:0:(genops.c:885:class_export_put()) final put ffff8df682adf000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1789127418.387390:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8df682adf000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1789127418.387394:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1789127418.387438:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8df7af45b000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1789127418.387442:0:36:0:(genops.c:885:class_export_put()) final put ffff8df7b45fe000/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1789127418.387444:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8df7b45fe000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1789127418.387448:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1789127418.388024:0:13676:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8df7b45ff800 00000020:01000000:2.0:1789127418.388056:0:13676:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1789127418.388064:0:13676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789127418.388069:0:13676:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789127418.388072:0:13676:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff8df7881db490) has no exports 00000020:00000080:2.0:1789127418.388094:0:13676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789127418.388100:0:13676:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1789127418.388103:0:13676:0:(genops.c:885:class_export_put()) final put ffff8df7bb5d7800/OSS_uuid 00000020:00000080:2.0:1789127418.388105:0:13676:0:(genops.c:844:class_export_destroy()) destroying export ffff8df7bb5d7800/OSS_uuid for OSS 00000020:01000000:2.0:1789127418.388109:0:13676:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:2.0:1789127418.388178:0:8063:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff8df6813f8000:8063] 3 exiting: rc = 0 00000100:00080000:1.0:1789127418.388424:0:5826:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1789127418.388528:0:6686:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff8df787b49c00:6686] 0 exiting: rc = 1 00000100:00100000:2.0:1789127418.390182:0:6688:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff8df7bbeee000:6688] 1 exiting: rc = 0 00000100:00100000:1.0:1789127418.390697:0:6689:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff8df7bbeee800:6689] 2 exiting: rc = 0 00000100:00100000:2.0:1789127418.390847:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.390869:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.390881:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.390886:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.390891:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.390895:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.390900:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.390904:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.390909:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.390914:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.390919:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.390923:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.390928:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.390933:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.390937:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.390942:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.390947:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.390953:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.390958:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.390963:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.390968:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.390973:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.390978:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.390999:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.391047:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.391051:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.391056:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.391061:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.391066:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.391071:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.391075:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.391080:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.391084:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.391089:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.391093:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.391097:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.391108:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.391112:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.391116:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.391120:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.391125:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.391315:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.391322:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.391327:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.391333:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.391337:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.391342:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.391346:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.391350:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.391355:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.391359:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.391567:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.391574:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.391578:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.391583:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.391587:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.391591:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.391596:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.391600:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.391605:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.391613:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.391617:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.391624:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.391872:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.392902:0:6691:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8df7bbeefc00:6691] 1 exiting: rc = 0 00000100:00100000:1.0:1789127418.392973:0:10333:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff8df6813afc00:10333] 2 exiting: rc = 0 00000100:00100000:1.0:1789127418.393922:0:6690:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8df7bbeefa00:6690] 0 exiting: rc = 1 00000100:00100000:2.0:1789127418.394030:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.394041:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.394046:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.394051:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.394057:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.394062:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.394068:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.394085:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.394090:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.394095:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.394100:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.394105:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.394111:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.394116:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.394122:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.394127:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.394139:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.394144:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.394149:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.394154:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.394160:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.394165:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.394171:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.394176:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.394181:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.394186:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.394191:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.394197:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.394202:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.394222:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.394229:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.394234:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.394240:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.394245:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.394249:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.394254:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.394258:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.394264:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.394268:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.394273:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.394277:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.394283:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.394294:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.394300:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.394305:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.394310:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.394315:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.394320:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.394325:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.394331:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.394336:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.394342:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.394347:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.394352:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.394357:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.394363:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.394368:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.394373:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.394378:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.394383:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.394388:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.394394:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.394399:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.394404:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.395888:0:6692:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8df7889cde00:6692] 0 exiting: rc = 1 00000100:00100000:2.0:1789127418.396171:0:6693:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8df7889cd200:6693] 1 exiting: rc = 0 00000100:00100000:2.0:1789127418.398658:0:6694:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8df7869c0200:6694] 2 exiting: rc = 0 00000100:00100000:1.0:1789127418.398926:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.398933:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.398939:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.398952:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.398960:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.398966:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.398972:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.398977:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.398982:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.398987:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.398992:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.398997:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.399050:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.399056:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.399061:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.399069:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.399073:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.399078:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.399083:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.399088:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.399093:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.399098:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.399103:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.399110:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.399115:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.399119:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.399124:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.399137:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.399142:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.399147:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.399152:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.399156:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.399161:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.399167:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.399173:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.399178:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.399202:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.399210:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.399216:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.399222:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.399227:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.399232:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.399238:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.399243:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.399249:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.399253:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.399258:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.399270:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.399275:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.399280:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.399285:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.399290:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.399294:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.399300:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.399306:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.399311:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.399316:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.399322:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.399327:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.399332:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.399337:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.399346:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.399354:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.399363:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127418.406261:0:6696:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8df790cede00:6696] 1 exiting: rc = 0 00000100:00100000:0.0:1789127418.407744:0:6695:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8df790ced600:6695] 0 exiting: rc = 1 00000100:00100000:1.0:1789127418.443775:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.443783:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.443805:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.443811:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.443816:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.443821:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.443826:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.443831:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.443835:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.443840:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.443845:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.443850:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.443855:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.443859:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.443863:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.443868:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.443900:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.443907:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.443923:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.443928:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.443978:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.443983:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.443987:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.443992:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.443996:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.444001:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.444005:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.444010:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.444015:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.444019:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.444024:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.444028:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.444033:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.444038:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.444043:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.444047:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.444052:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.444057:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.444062:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.444066:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.444071:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.444076:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.444081:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.444086:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.444091:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.444096:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.444100:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.444105:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.444109:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.444114:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.444118:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.444122:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.444127:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.444150:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.444155:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.444160:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.444165:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.444170:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.444175:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.444180:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.444185:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.444190:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.444194:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127418.444199:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.448930:0:6697:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8df7b5871c00:6697] 0 exiting: rc = 1 00000100:00100000:1.0:1789127418.449699:0:6698:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8df7b5871a00:6698] 1 exiting: rc = 0 00000100:00100000:2.0:1789127418.465973:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.465985:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.466000:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.466007:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.466013:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.466019:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.466025:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.466031:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.466037:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.466055:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.466061:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.466076:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.466101:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.466108:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.466113:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.466119:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.466124:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.466130:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.466136:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.466142:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.466148:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.466154:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.466160:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.466166:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.466184:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.466191:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.466197:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.466202:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.466208:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.466213:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.466219:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.466225:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.466231:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.466237:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.466243:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.466250:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.466272:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.466281:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.466288:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.466295:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.466303:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.466310:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.466317:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.466323:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.466336:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.466346:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.466353:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.466360:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.466384:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.466392:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.466413:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.466422:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.468038:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.468055:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.468061:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.468066:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.468072:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.468077:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.468084:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.468090:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.468125:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.468139:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.468147:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127418.468155:0:13676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1789127418.479332:0:13676:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1789127433.240104:0:14289:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg640-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1789127441.976178:0:14751:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789127441.976184:0:14751:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1789127441.976292:0:14751:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8df7bfc78000 00000020:01000004:2.0:1789127441.976318:0:14751:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1789127441.976325:0:14751:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1789127441.976347:0:14751:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8df790231a48) 00000020:00000080:2.0:1789127441.976359:0:14751:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1789127442.027022:0:14751:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1789127442.031445:0:14751:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:0.0:1789127442.031990:0:14751:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 525: rc = 0 00100000:10000000:0.0:1789127442.032510:0:14751:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1789127442.032588:0:14751:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 525: rc = 0 00100000:10000000:0.0:1789127442.032693:0:14751:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 525: rc = 0 00100000:10000000:0.0:1789127442.032857:0:14751:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 525: rc = 0 00100000:10000000:0.0:1789127442.032953:0:14751:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 525: rc = 0 00100000:10000000:0.0:1789127442.033041:0:14751:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 525: rc = 0 00100000:10000000:0.0:1789127442.036516:0:14751:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 527: rc = 0 00100000:10000000:0.0:1789127442.038954:0:14751:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 529: rc = 0 00100000:10000000:0.0:1789127442.039055:0:14751:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 529: rc = 0 00100000:10000000:0.0:1789127442.040440:0:14751:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 536: rc = 0 00100000:10000000:0.0:1789127442.045655:0:14751:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 536: rc = 0 00100000:10000000:0.0:1789127442.047894:0:14751:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 536: rc = 0 00100000:10000000:0.0:1789127442.048410:0:14751:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 536: rc = 0 00100000:10000000:0.0:1789127442.048714:0:14751:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 536: rc = 0 00100000:10000000:0.0:1789127442.051110:0:14751:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 536: rc = 0 00100000:10000000:0.0:1789127442.053397:0:14751:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 536: rc = 0 00100000:10000000:0.0:1789127442.055037:0:14751:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 536: rc = 0 00100000:10000000:0.0:1789127442.057639:0:14751:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 536: rc = 0 00100000:10000000:0.0:1789127442.057959:0:14751:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 536: rc = 0 00100000:10000000:0.0:1789127442.059674:0:14751:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 536: rc = 0 00100000:10000000:0.0:1789127442.062921:0:14751:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 536: rc = 0 00100000:10000000:0.0:1789127442.064685:0:14751:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 453: rc = 0 00100000:10000000:0.0:1789127442.065779:0:14751:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 453: rc = 0 00100000:10000000:0.0:1789127442.066077:0:14751:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 453: rc = 0 00100000:10000000:0.0:1789127442.068456:0:14751:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 453: rc = 0 00100000:10000000:2.0:1789127442.069050:0:14751:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 453: rc = 0 00100000:10000000:2.0:1789127442.069410:0:14751:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 453: rc = 0 00100000:10000000:2.0:1789127442.069906:0:14751:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 453: rc = 0 00100000:10000000:2.0:1789127442.070135:0:14751:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 453: rc = 0 00100000:10000000:2.0:1789127442.071712:0:14751:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 453: rc = 0 00100000:10000000:2.0:1789127442.074803:0:14751:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 453: rc = 0 00100000:10000000:2.0:1789127442.075097:0:14751:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 453: rc = 0 00100000:10000000:2.0:1789127442.075348:0:14751:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 453: rc = 0 00100000:10000000:2.0:1789127442.075591:0:14751:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 453: rc = 0 00100000:10000000:2.0:1789127442.077884:0:14751:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 453: rc = 0 00100000:10000000:2.0:1789127442.078128:0:14751:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 453: rc = 0 00100000:10000000:2.0:1789127442.079742:0:14751:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 453: rc = 0 00100000:10000000:2.0:1789127442.080091:0:14751:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 453: rc = 0 00100000:10000000:2.0:1789127442.080518:0:14751:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 453: rc = 0 00100000:10000000:2.0:1789127442.080783:0:14751:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 453: rc = 0 00100000:10000000:2.0:1789127442.081076:0:14751:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 453: rc = 0 00100000:10000000:2.0:1789127442.083492:0:14751:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 453: rc = 0 00100000:10000000:2.0:1789127442.085115:0:14751:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 453: rc = 0 00100000:10000000:2.0:1789127442.085540:0:14751:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 453: rc = 0 00100000:10000000:2.0:1789127442.085826:0:14751:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 453: rc = 0 00100000:10000000:2.0:1789127442.086067:0:14751:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 453: rc = 0 00100000:10000000:2.0:1789127442.087833:0:14751:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 453: rc = 0 00100000:10000000:2.0:1789127442.088120:0:14751:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 453: rc = 0 00100000:10000000:2.0:1789127442.090036:0:14751:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 453: rc = 0 00100000:10000000:2.0:1789127442.090434:0:14751:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 453: rc = 0 00100000:10000000:2.0:1789127442.090815:0:14751:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 453: rc = 0 00100000:10000000:2.0:1789127442.094030:0:14751:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 453: rc = 0 00100000:10000000:2.0:1789127442.094894:0:14751:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 453: rc = 0 00100000:10000000:2.0:1789127442.095245:0:14751:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 768: rc = 0 00100000:10000000:2.0:1789127442.096055:0:14751:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1789127442.096205:0:14751:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 533: rc = 0 00100000:10000000:2.0:1789127442.100769:0:14751:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:3.0:1789127442.101323:0:14751:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 533: rc = 0 00100000:10000000:3.0:1789127442.101593:0:14751:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:3.0:1789127442.101661:0:14751:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 533: rc = 0 00100000:10000000:3.0:1789127442.102037:0:14751:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:3.0:1789127442.102107:0:14751:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 530: rc = 0 00100000:10000000:3.0:1789127442.102312:0:14751:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:3.0:1789127442.102395:0:14751:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 530: rc = 0 00100000:10000000:3.0:1789127442.102577:0:14751:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1789127442.102646:0:14751:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 530: rc = 0 00000020:00000080:3.0:1789127442.102930:0:14751:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1789127442.102937:0:14751:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789127442.102947:0:14751:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xeeacf7c02430141e 00000020:01000004:3.0:1789127442.102954:0:14751:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1789127442.102959:0:14751:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1789127442.102965:0:14751:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8df7bfc78000 from MGS 00000020:01000004:3.0:1789127442.102968:0:14751:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1789127442.102978:0:14751:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8df7881d8000) 00000020:00000080:3.0:1789127442.102988:0:14751:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1789127442.103038:0:14751:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8df7bfc78000 from MGS, refs=2 00080000:01000000:3.0:1789127442.103043:0:14751:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789127442.103048:0:14751:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xeeacf7c02430142c 00000100:00100000:3.0:1789127442.103134:0:14751:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1789127442.103261:0:14751:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1789127442.103267:0:14751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1789127442.108119:0:14751:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1789127442.108132:0:14751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1789127442.108810:0:14751:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789127442.108964:0:14751:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1789127442.108968:0:14751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1789127442.112358:0:14751:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1789127442.112374:0:14751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1789127442.124107:0:14751:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1789127442.124122:0:14751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1789127442.124889:0:14757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127442.124893:0:14757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127442.124895:0:14757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127442.125181:0:14758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127442.125183:0:14758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127442.125185:0:14758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127442.125650:0:14751:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1789127442.136206:0:14757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1789127442.156142:0:14751:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1789127442.156169:0:14751:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1789127442.156171:0:14751:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1789127442.160200:0:14760:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1789127442.160404:0:14751:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1789127442.160536:0:14751:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789127442.161094:0:14751:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1789127442.161465:0:14751:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789127442.161633:0:14751:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1789127442.161639:0:14751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1789127442.173950:0:14751:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1789127442.173964:0:14751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1789127442.174300:0:14751:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1789127442.174306:0:14751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1789127442.175651:0:14751:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1789127442.175672:0:14751:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.140@tcp' 00000020:01000004:2.0:1789127442.175674:0:14751:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1789127442.175705:0:14751:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.140@tcp (typ=mgc) 00000020:00000080:2.0:1789127442.175717:0:14751:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.140@tcp (ffff8df790230000) 00000020:00000080:2.0:1789127442.175732:0:14751:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1789127442.175835:0:14751:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8df681af8000@MGC192.168.206.140@tcp: add connection 192.168.206.140@tcp at head 00010000:00010000:2.0:1789127442.175983:0:14751:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.140@tcp-0 is initialized 00000040:01000000:2.0:1789127442.175989:0:14751:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.140@tcp ctxt 1 is initialized 00000100:00080000:1.0:1789127442.177927:0:14765:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1789127442.183828:0:14767:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1789127442.184228:0:14751:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.140@tcp (uuid 396611f1-c34a-4e5a-8396-03624226b0e0) 00000020:00000080:2.0:1789127442.184256:0:14751:0:(genops.c:1385:class_connect()) connect: client 396611f1-c34a-4e5a-8396-03624226b0e0, cookie 0xeeacf7c02430143a 00000100:00080000:2.0:1789127442.184266:0:14751:0:(import.c:510:import_select_connection()) MGC192.168.206.140@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789127442.184272:0:14751:0:(import.c:624:import_select_connection()) MGC192.168.206.140@tcp: import ffff8df681af8000 using connection 192.168.206.140@tcp/0@lo 00000100:00100000:2.0:1789127442.184305:0:14751:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df6826a5a40 x1876035752780032/t0(0) o250->MGC192.168.206.140@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789127442.184341:0:14751:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 396611f1-c34a-4e5a-8396-03624226b0e0->MGS 00000020:01000004:2.0:1789127442.184363:0:14751:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1789127442.184368:0:14751:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1789127442.184380:0:14751:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8df790233490) 00000020:00000080:2.0:1789127442.184392:0:14751:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1789127442.187320:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6826a5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:396611f1-c34a-4e5a-8396-03624226b0e0:3299:1876035752780032:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1789127442.187405:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127442.190058:0:14761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752780032 00000100:00100000:3.0:1789127442.190071:0:14761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752780032 00000100:00100000:3.0:1789127442.190112:0:14761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789127442.190120:0:14761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7af7ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3299:x1876035752780032:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1789127442.190144:0:14761:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from 396611f1-c34a-4e5a-8396-03624226b0e0@0@lo t0 exp 0000000000000000 cur 388 last 0 00000020:00000080:3.0:1789127442.190171:0:14761:0:(genops.c:1385:class_connect()) connect: client 396611f1-c34a-4e5a-8396-03624226b0e0, cookie 0xeeacf7c024301448 00000100:00080000:3.0:1789127442.190317:0:14761:0:(import.c:65:import_set_state_nolock()) ffff8df78efd3000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789127442.190416:0:14761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7af7ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:396611f1-c34a-4e5a-8396-03624226b0e0+5:3299:x1876035752780032:12345-0@lo:250:mount.lustre.0 Request processed in 296us (3011us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127442.190424:0:14761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789127442.190485:0:3299:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.206.140@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1789127442.190495:0:3299:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.206.140@tcp: connect to target with instance 0 00000100:00080000:3.0:1789127442.190502:0:3299:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.206.140@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1789127442.190507:0:3299:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1789127442.190510:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8df681af8000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1789127442.190513:0:3299:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1789127442.190530:0:3299:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1789127442.190535:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6826a5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:396611f1-c34a-4e5a-8396-03624226b0e0:3299:1876035752780032:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1789127442.202078:0:14751:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789127442.202266:0:14751:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1789127442.202272:0:14751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1789127442.203140:0:14751:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1789127442.203148:0:14751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1789127442.203582:0:14751:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1789127442.203588:0:14751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1789127442.204776:0:14751:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789127442.205106:0:14751:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1789127442.205111:0:14751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1789127442.208193:0:14751:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1789127442.208205:0:14751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1789127442.259307:0:14751:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789127442.260235:0:14751:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1789127442.260244:0:14751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1789127442.261958:0:14751:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1789127442.261970:0:14751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1789127442.262630:0:14751:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789127442.262777:0:14751:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789127442.262782:0:14751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1789127442.266964:0:14751:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789127442.266977:0:14751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1789127442.268293:0:14751:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789127442.268554:0:14751:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789127442.268560:0:14751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1789127442.269394:0:14751:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789127442.269401:0:14751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1789127442.272291:0:14751:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789127442.272703:0:14751:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789127442.272710:0:14751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1789127442.273527:0:14751:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789127442.273535:0:14751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1789127442.310928:0:14751:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789127442.311125:0:14751:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789127442.311131:0:14751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1789127442.316596:0:14751:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789127442.316612:0:14751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1789127442.318284:0:14751:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1789127442.318306:0:14751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1789127442.329344:0:14751:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1789127442.329370:0:14751:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1789127442.329375:0:14751:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.140@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1789127442.329493:0:14751:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.140@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789127442.329524:0:14751:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.140@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1789127442.329527:0:14751:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789127442.329529:0:14751:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789127442.329530:0:14751:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789127442.329532:0:14751:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789127442.329533:0:14751:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789127442.329538:0:14751:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789127442.329539:0:14751:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789127442.329540:0:14751:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789127442.329541:0:14751:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789127442.329542:0:14751:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789127442.329544:0:14751:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1789127442.329546:0:14751:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789127442.329547:0:14751:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789127442.329548:0:14751:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789127442.329549:0:14751:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789127442.329550:0:14751:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789127442.329551:0:14751:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789127442.329552:0:14751:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789127442.329553:0:14751:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789127442.329553:0:14751:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789127442.329554:0:14751:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789127442.329578:0:14751:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1789127442.329596:0:14751:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6826a4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:14751:1876035752780160:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789127442.329678:0:14751:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127442.329733:0:14751:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7af618780 going to sleep for 11 seconds 00000100:00100000:1.0:1789127442.331283:0:14764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752780160 00000100:00100000:1.0:1789127442.331295:0:14764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752780160 00000100:00100000:1.0:1789127442.331364:0:14764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789127442.331374:0:14764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7af7cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:396611f1-c34a-4e5a-8396-03624226b0e0+5:14751:x1876035752780160:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789127442.331413:0:14764:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789127442.331416:0:14764:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1789127442.331419:0:14764:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1789127442.332915:0:14785:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1789127442.333289:0:14764:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:3.0:1789127442.334878:0:14786:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1789127442.334884:0:14786:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1789127442.334887:0:14786:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1789127442.334920:0:14786:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:1.0:1789127442.338962:0:14764:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789127442.338976:0:14764:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1789127442.350324:0:14764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7af7cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:396611f1-c34a-4e5a-8396-03624226b0e0+5:14751:x1876035752780160:12345-0@lo:253:mount.lustre.0 Request processed in 18944us (20639us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127442.350351:0:14764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789127442.350526:0:14751:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6826a4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:14751:1876035752780160:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789127442.350540:0:14751:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1789127442.350543:0:14751:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789127442.350545:0:14751:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789127442.350546:0:14751:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789127442.350547:0:14751:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789127442.350548:0:14751:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789127442.350550:0:14751:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789127442.350551:0:14751:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789127442.350552:0:14751:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789127442.350554:0:14751:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789127442.350555:0:14751:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789127442.350572:0:14751:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8df7bfc78000 from lustre-MDT0000 10000000:01000000:3.0:1789127442.350592:0:14751:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1789127442.350594:0:14751:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789127442.350598:0:14751:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8df790230000 10000000:01000000:3.0:1789127442.350602:0:14751:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789127442.350609:0:14751:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8df790230000 from 1 10000000:01000000:3.0:1789127442.350611:0:14751:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789127442.350644:0:14751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df7c2050c00/0xeeacf7c02430144f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127442.350653:0:14751:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff8df7c2050c00/0xeeacf7c02430144f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127442.350661:0:14751:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff8df7c2050c00/0xeeacf7c02430144f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127442.350690:0:14751:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae041e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:14751:1876035752780288:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789127442.350725:0:14751:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127442.350827:0:14751:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df783973600 going to sleep for 11 seconds 00000100:00100000:1.0:1789127442.351380:0:14763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752780288 00000100:00100000:1.0:1789127442.351386:0:14763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752780288 00000100:00100000:1.0:1789127442.351460:0:14763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789127442.351469:0:14763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b404b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:396611f1-c34a-4e5a-8396-03624226b0e0+5:14751:x1876035752780288:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789127442.351481:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127442.351496:0:14763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df7bbd96200/0xeeacf7c024301456 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xeeacf7c02430144f expref: -99 pid: 14763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127442.351516:0:14763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df7bbd96200/0xeeacf7c024301456 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xeeacf7c02430144f expref: 6 pid: 14763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127442.351527:0:14763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df7bbd96200/0xeeacf7c024301456 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c02430144f expref: 6 pid: 14763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127442.351536:0:14763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7bbd96200, rc 0) 00000100:00100000:1.0:1789127442.351579:0:14763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b404b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:396611f1-c34a-4e5a-8396-03624226b0e0+6:14751:x1876035752780288:12345-0@lo:101:mount.lustre.0 Request processed in 112us (853us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127442.351586:0:14763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789127442.351643:0:14751:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae041e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:14751:1876035752780288:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789127442.351657:0:14751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff8df7c2050c00/0xeeacf7c02430144f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c024301456 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127442.351666:0:14751:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff8df7c2050c00/0xeeacf7c02430144f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xeeacf7c024301456 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127442.351713:0:14751:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6826a43c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:14751:1876035752780416:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789127442.351740:0:14751:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127442.351967:0:14751:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7af618cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789127442.352043:0:14761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752780416 00000100:00100000:3.0:1789127442.352048:0:14761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752780416 00000100:00100000:3.0:1789127442.352069:0:14761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789127442.352076:0:14761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b4049050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:396611f1-c34a-4e5a-8396-03624226b0e0+6:14751:x1876035752780416:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789127442.352532:0:14761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b4049050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:396611f1-c34a-4e5a-8396-03624226b0e0+6:14751:x1876035752780416:12345-0@lo:501:mount.lustre.0 Request processed in 455us (790us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789127442.352540:0:14761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789127442.352611:0:14751:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6826a43c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:14751:1876035752780416:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1789127442.352635:0:14751:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789127442.352654:0:14751:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df7c2050c00/0xeeacf7c02430144f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c024301456 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127442.352664:0:14751:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff8df7c2050c00/0xeeacf7c02430144f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c024301456 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127442.352673:0:14751:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8df7bfc78000 10000000:01000000:2.0:1789127442.352677:0:14751:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789127442.352681:0:14751:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8df7bfc78000 10000000:01000000:2.0:1789127442.352683:0:14751:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1789127442.352686:0:14751:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8df7bfc78000 from 1 10000000:01000000:2.0:1789127442.352688:0:14751:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1789127442.352708:0:14751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df7aeab7000/0xeeacf7c02430145d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127442.352716:0:14751:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff8df7aeab7000/0xeeacf7c02430145d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127442.352725:0:14751:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff8df7aeab7000/0xeeacf7c02430145d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127442.352739:0:14751:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6826a43c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:14751:1876035752780544:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789127442.352768:0:14751:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127442.352782:0:14751:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7af618cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789127442.352869:0:14761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752780544 00000100:00100000:3.0:1789127442.352874:0:14761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752780544 00000100:00100000:3.0:1789127442.352895:0:14761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789127442.352901:0:14761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b4049c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:396611f1-c34a-4e5a-8396-03624226b0e0+6:14751:x1876035752780544:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789127442.352909:0:14761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127442.352921:0:14761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df7c2050a00/0xeeacf7c024301464 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xeeacf7c02430145d expref: -99 pid: 14761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127442.352937:0:14761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df7c2050a00/0xeeacf7c024301464 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xeeacf7c02430145d expref: 7 pid: 14761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127442.352946:0:14761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df7c2050a00/0xeeacf7c024301464 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c02430145d expref: 7 pid: 14761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127442.352954:0:14761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7c2050a00, rc 0) 00000100:00100000:3.0:1789127442.352992:0:14761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b4049c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:396611f1-c34a-4e5a-8396-03624226b0e0+7:14751:x1876035752780544:12345-0@lo:101:mount.lustre.0 Request processed in 91us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127442.353009:0:14761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789127442.353113:0:14751:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6826a43c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:14751:1876035752780544:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789127442.353124:0:14751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff8df7aeab7000/0xeeacf7c02430145d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c024301464 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127442.353152:0:14751:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff8df7aeab7000/0xeeacf7c02430145d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xeeacf7c024301464 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127442.353163:0:14751:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1789127442.353172:0:14751:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df7aeab7000/0xeeacf7c02430145d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c024301464 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127442.353179:0:14751:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff8df7aeab7000/0xeeacf7c02430145d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c024301464 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127442.353185:0:14751:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1789127442.353189:0:14751:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789127442.353193:0:14751:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8df7bfc78000 10000000:01000000:2.0:1789127442.353195:0:14751:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1789127442.353198:0:14751:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1789127442.353200:0:14751:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789127442.353213:0:14751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df7aeab6800/0xeeacf7c02430146b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127442.353219:0:14751:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff8df7aeab6800/0xeeacf7c02430146b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127442.353225:0:14751:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff8df7aeab6800/0xeeacf7c02430146b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127442.353238:0:14751:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6826a43c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:14751:1876035752780672:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789127442.353274:0:14751:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127442.353293:0:14751:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7af618cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789127442.353531:0:14761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752780672 00000100:00100000:3.0:1789127442.353536:0:14761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752780672 00000100:00100000:3.0:1789127442.353557:0:14761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789127442.353562:0:14761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b4048c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:396611f1-c34a-4e5a-8396-03624226b0e0+7:14751:x1876035752780672:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789127442.353570:0:14761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127442.353578:0:14761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df7c2051400/0xeeacf7c024301472 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xeeacf7c02430146b expref: -99 pid: 14761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127442.353592:0:14761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df7c2051400/0xeeacf7c024301472 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xeeacf7c02430146b expref: 8 pid: 14761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127442.353600:0:14761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df7c2051400/0xeeacf7c024301472 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c02430146b expref: 8 pid: 14761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127442.353607:0:14761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7c2051400, rc 0) 00000100:00100000:3.0:1789127442.353644:0:14761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b4048c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:396611f1-c34a-4e5a-8396-03624226b0e0+8:14751:x1876035752780672:12345-0@lo:101:mount.lustre.0 Request processed in 81us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127442.353650:0:14761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789127442.353710:0:14751:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6826a43c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:14751:1876035752780672:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789127442.353721:0:14751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff8df7aeab6800/0xeeacf7c02430146b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c024301472 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127442.353727:0:14751:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff8df7aeab6800/0xeeacf7c02430146b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xeeacf7c024301472 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127442.353762:0:14751:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6826a43c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:14751:1876035752780800:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789127442.353902:0:14751:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127442.353948:0:14751:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7af618cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789127442.354006:0:14764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752780800 00000100:00100000:0.0:1789127442.354010:0:14764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752780800 00000100:00100000:3.0:1789127442.354207:0:14761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789127442.354215:0:14761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b404a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:396611f1-c34a-4e5a-8396-03624226b0e0+8:14751:x1876035752780800:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789127442.354708:0:14761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b404a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:396611f1-c34a-4e5a-8396-03624226b0e0+9:14751:x1876035752780800:12345-0@lo:501:mount.lustre.0 Request processed in 493us (921us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127442.354716:0:14761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789127442.355430:0:14751:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6826a43c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:14751:1876035752780800:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789127442.355473:0:14751:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6826a43c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:14751:1876035752780928:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789127442.355521:0:14751:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127442.355554:0:14751:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7af618cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789127442.355597:0:14761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752780928 00000100:00100000:3.0:1789127442.355602:0:14761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752780928 00000100:00100000:3.0:1789127442.355642:0:14761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789127442.355659:0:14761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b404bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:396611f1-c34a-4e5a-8396-03624226b0e0+9:14751:x1876035752780928:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789127442.357017:0:14761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b404bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:396611f1-c34a-4e5a-8396-03624226b0e0+9:14751:x1876035752780928:12345-0@lo:503:mount.lustre.0 Request processed in 1355us (1490us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127442.357029:0:14761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789127442.357225:0:14751:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6826a43c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:14751:1876035752780928:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789127442.357920:0:14787:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae2f9e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:396611f1-c34a-4e5a-8396-03624226b0e0:14787:1876035752781056:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789127442.357972:0:14787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127442.358117:0:14787:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df788830780 going to sleep for 11 seconds 00000100:00100000:3.0:1789127442.358394:0:14763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752781056 00000100:00100000:3.0:1789127442.358400:0:14763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752781056 00000100:00100000:3.0:1789127442.358488:0:14763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789127442.358497:0:14763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b404a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:396611f1-c34a-4e5a-8396-03624226b0e0+9:14787:x1876035752781056:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789127442.358778:0:14763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b404a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:396611f1-c34a-4e5a-8396-03624226b0e0+9:14787:x1876035752781056:12345-0@lo:502:llog_process_th.0 Request processed in 281us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127442.358820:0:14763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789127442.358903:0:14787:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae2f9e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:396611f1-c34a-4e5a-8396-03624226b0e0:14787:1876035752781056:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789127442.358929:0:14787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789127442.358940:0:14787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127442.358943:0:14787:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1789127442.358948:0:14787:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1789127442.358951:0:14787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789127442.358973:0:14787:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8df790d38000) 00000020:00000080:1.0:1789127442.358989:0:14787:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1789127442.358994:0:14787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1789127442.359532:0:14787:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:1.0:1789127442.359541:0:14787:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xeeacf7c024301480 00000020:00000080:1.0:1789127442.359748:0:14787:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1789127442.359753:0:14787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789127442.359757:0:14787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127442.359759:0:14787:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1789127442.359762:0:14787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789127442.359765:0:14787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127442.359767:0:14787:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1789127442.359769:0:14787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789127442.359776:0:14787:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8df790d3ced8) 00000020:00000080:1.0:1789127442.359825:0:14787:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1789127442.359830:0:14787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1789127442.359832:0:14787:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1789127442.359835:0:14787:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1789127442.359841:0:14787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789127442.359892:0:14787:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8df7bfc78000 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1789127442.359905:0:14787:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8df790d3b490) 00000020:00000080:1.0:1789127442.359915:0:14787:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1789127442.359962:0:14787:0:(lod_dev.c:2292:lod_obd_connect()) connect #0 00000020:00000080:1.0:1789127442.359968:0:14787:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xeeacf7c024301495 00000020:00000080:1.0:1789127442.360202:0:14787:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1789127442.360209:0:14787:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1789127442.360214:0:14787:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xeeacf7c02430149c 00080000:01000000:1.0:1789127442.360219:0:14787:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:1.0:1789127442.360222:0:14787:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xeeacf7c0243014a3 00010000:00010000:3.0:1789127442.472987:0:14787:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1789127442.473389:0:14787:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967527 00000001:00080000:3.0:1789127442.473553:0:14787:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1789127442.474045:0:14787:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8df7881db490) 00000020:00000080:3.0:1789127442.474061:0:14787:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1789127442.474137:0:14787:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:3.0:1789127442.474144:0:14787:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xeeacf7c0243014b1 00000020:00000080:0.0:1789127442.479688:0:14787:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1789127442.486321:0:14787:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xeeacf7c0243014b8 00000020:00000080:0.0:1789127442.491436:0:14787:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1789127442.491451:0:14787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789127442.491459:0:14787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127442.491461:0:14787:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1789127442.491467:0:14787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789127442.491473:0:14787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127442.491474:0:14787:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1789127442.491478:0:14787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1789127442.491523:0:14787:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1789127442.491538:0:14787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789127442.491542:0:14787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127442.491543:0:14787:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1789127442.491545:0:14787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789127442.491547:0:14787:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #10 00000020:01000000:0.0:1789127442.491549:0:14787:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789127442.491551:0:14787:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789127442.491552:0:14787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789127442.491554:0:14787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127442.491569:0:14787:0:(obd_config.c:1563:class_process_config()) marker 10 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789127442.491573:0:14787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789127442.491576:0:14787:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1789127442.491580:0:14787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127442.491581:0:14787:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1789127442.491584:0:14787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789127442.491589:0:14787:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.140@tcp to nid 0x20000c0a8ce8c (192.168.206.140@tcp) 00000020:01000000:0.0:1789127442.491625:0:14787:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1789127442.491628:0:14787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789127442.491643:0:14787:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8df7af709a48) 00000020:00000080:0.0:1789127442.491659:0:14787:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1789127442.491664:0:14787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789127442.491716:0:14787:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1789127442.491721:0:14787:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:0.0:1789127442.491727:0:14787:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xeeacf7c0243014c6 00010000:00080000:0.0:1789127442.491757:0:14787:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8df78803a800@lustre-OST0000-osc-MDT0000: add connection 192.168.206.140@tcp at head 00010000:00010000:0.0:1789127442.492169:0:14787:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:0.0:1789127442.492619:0:14787:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1789127442.492664:0:14787:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1789127442.505610:0:14787:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789127442.506632:0:14787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1789127442.506732:0:14787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1789127442.520144:0:14791:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789127442.520155:0:14791:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1789127442.527833:0:14787:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789127442.527856:0:14787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789127442.527904:0:14787:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1789127442.527920:0:14787:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xeeacf7c0243014cd 00000100:00080000:1.0:1789127442.527945:0:14787:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789127442.527952:0:14787:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8df78803a800 using connection 192.168.206.140@tcp/0@lo 00000100:00100000:1.0:1789127442.527998:0:14787:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df7ae2f9e00 x1876035752781184/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789127442.528027:0:14787:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1789127442.528315:0:14787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789127442.528319:0:14787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127442.528320:0:14787:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1789127442.528323:0:14787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789127442.528336:0:14787:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:1.0:1789127442.528338:0:14787:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789127442.528339:0:14787:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789127442.528341:0:14787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789127442.528344:0:14787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127442.528345:0:14787:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789127442.528348:0:14787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789127442.528351:0:14787:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1789127442.528355:0:14787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127442.528356:0:14787:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1789127442.528359:0:14787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789127442.528362:0:14787:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.140@tcp to nid 0x20000c0a8ce8c (192.168.206.140@tcp) 00000020:01000000:1.0:1789127442.528385:0:14787:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789127442.528387:0:14787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789127442.528398:0:14787:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8df790d39a48) 00000020:00000080:1.0:1789127442.528409:0:14787:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1789127442.528413:0:14787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789127442.528462:0:14787:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1789127442.528468:0:14787:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:1.0:1789127442.528474:0:14787:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xeeacf7c0243014db 00010000:00080000:1.0:1789127442.528503:0:14787:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8df7bb5d1800@lustre-OST0001-osc-MDT0000: add connection 192.168.206.140@tcp at head 00010000:00010000:1.0:1789127442.528704:0:14787:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1789127442.528916:0:14787:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1789127442.530747:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae2f9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1876035752781184:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789127442.530846:0:3299:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876035752781184 offset 0 length 520: 4 00000040:01000000:1.0:1789127442.533156:0:14787:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1789127442.535134:0:14787:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789127442.535217:0:14787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1789127442.535296:0:14787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:2.0:1789127442.535782:0:14793:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789127442.536395:0:14793:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1789127442.536780:0:14787:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789127442.536822:0:14787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789127442.536855:0:14787:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789127442.536873:0:14787:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xeeacf7c0243014e2 00000100:00080000:1.0:1789127442.536882:0:14787:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789127442.536888:0:14787:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8df7bb5d1800 using connection 192.168.206.140@tcp/0@lo 00000100:00100000:1.0:1789127442.536922:0:14787:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df7ae2f8b40 x1876035752781312/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789127442.537007:0:14787:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1789127442.537246:0:14787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789127442.537251:0:14787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127442.537253:0:14787:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1789127442.537256:0:14787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789127442.537260:0:14787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127442.537261:0:14787:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789127442.537264:0:14787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789127442.537266:0:14787:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789127442.537269:0:14787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789127442.537271:0:14787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127442.537272:0:14787:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789127442.537274:0:14787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789127442.537277:0:14787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127442.537278:0:14787:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789127442.537281:0:14787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789127442.537312:0:14787:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae2fb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:396611f1-c34a-4e5a-8396-03624226b0e0:14787:1876035752781440:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789127442.537404:0:14787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127442.537444:0:14787:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7833fa780 going to sleep for 11 seconds 00000100:00100000:0.0:1789127442.537504:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae2f8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1876035752781312:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789127442.537590:0:3299:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876035752781312 offset 0 length 520: 4 00000100:00100000:2.0:1789127442.537656:0:14761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752781440 00000100:00100000:2.0:1789127442.537662:0:14761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752781440 00000100:00100000:2.0:1789127442.537704:0:14761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789127442.537712:0:14761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b404b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:396611f1-c34a-4e5a-8396-03624226b0e0+9:14787:x1876035752781440:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789127442.537999:0:14761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b404b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:396611f1-c34a-4e5a-8396-03624226b0e0+9:14787:x1876035752781440:12345-0@lo:502:llog_process_th.0 Request processed in 287us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127442.538007:0:14761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789127442.538509:0:14787:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae2fb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:396611f1-c34a-4e5a-8396-03624226b0e0:14787:1876035752781440:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789127442.538552:0:14787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789127442.538558:0:14787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127442.538561:0:14787:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789127442.538568:0:14787:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1789127442.538779:0:14751:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:2.0:1789127442.538822:0:14751:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789127442.538845:0:14751:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df7aeab6800/0xeeacf7c02430146b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c024301472 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127442.538854:0:14751:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff8df7aeab6800/0xeeacf7c02430146b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c024301472 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127442.538861:0:14751:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8df7bfc78000 from 1 10000000:01000000:2.0:1789127442.538863:0:14751:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789127442.538891:0:14751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df7aeab6200/0xeeacf7c0243014e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127442.538899:0:14751:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff8df7aeab6200/0xeeacf7c0243014e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127442.538907:0:14751:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff8df7aeab6200/0xeeacf7c0243014e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127442.538923:0:14751:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6826a6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:14751:1876035752781568:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789127442.538973:0:14751:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127442.538999:0:14751:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7869d8e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789127442.539236:0:14763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752781568 00000100:00100000:1.0:1789127442.539242:0:14763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752781568 00000100:00100000:1.0:1789127442.539272:0:14763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789127442.539279:0:14763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b4048450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:396611f1-c34a-4e5a-8396-03624226b0e0+9:14751:x1876035752781568:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789127442.539290:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127442.539301:0:14763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df7bbd96000/0xeeacf7c0243014f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xeeacf7c0243014e9 expref: -99 pid: 14763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127442.539320:0:14763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df7bbd96000/0xeeacf7c0243014f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xeeacf7c0243014e9 expref: 10 pid: 14763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127442.539340:0:14763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df7bbd96000/0xeeacf7c0243014f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c0243014e9 expref: 10 pid: 14763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127442.539348:0:14763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7bbd96000, rc 0) 00000100:00100000:1.0:1789127442.539379:0:14763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b4048450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:396611f1-c34a-4e5a-8396-03624226b0e0+10:14751:x1876035752781568:12345-0@lo:101:mount.lustre.0 Request processed in 100us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127442.539385:0:14763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789127442.539878:0:14751:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6826a6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:14751:1876035752781568:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789127442.539893:0:14751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff8df7aeab6200/0xeeacf7c0243014e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c0243014f0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127442.539915:0:14751:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff8df7aeab6200/0xeeacf7c0243014e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xeeacf7c0243014f0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127442.540622:0:14751:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6826a6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:14751:1876035752781696:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1789127442.540674:0:14751:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127442.540766:0:14751:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7869d8e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789127442.541255:0:14764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752781696 00000100:00100000:0.0:1789127442.541263:0:14764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752781696 00000100:00100000:0.0:1789127442.541346:0:14764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789127442.541355:0:14764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b404b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:396611f1-c34a-4e5a-8396-03624226b0e0+10:14751:x1876035752781696:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1789127442.541373:0:14764:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1789127442.541379:0:14764:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1789127442.541625:0:14764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b404b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:396611f1-c34a-4e5a-8396-03624226b0e0+10:14751:x1876035752781696:12345-0@lo:256:mount.lustre.0 Request processed in 269us (949us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127442.541633:0:14764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789127442.541707:0:14751:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6826a6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:14751:1876035752781696:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1789127442.542419:0:14751:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789127442.542484:0:14751:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df7aeab6200/0xeeacf7c0243014e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c0243014f0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127442.542496:0:14751:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff8df7aeab6200/0xeeacf7c0243014e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c0243014f0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127442.542504:0:14751:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df7bfc78000 from 1 10000000:01000000:2.0:1789127442.542507:0:14751:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789127442.542534:0:14751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df7aeab6e00/0xeeacf7c0243014f7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127442.542543:0:14751:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff8df7aeab6e00/0xeeacf7c0243014f7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127442.542552:0:14751:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff8df7aeab6e00/0xeeacf7c0243014f7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127442.542568:0:14751:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6826a6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:14751:1876035752781824:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789127442.542605:0:14751:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127442.542672:0:14751:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7869d8e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789127442.542723:0:14761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752781824 00000100:00100000:1.0:1789127442.542728:0:14761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752781824 00000100:00100000:1.0:1789127442.542772:0:14761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789127442.542780:0:14761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b404ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:396611f1-c34a-4e5a-8396-03624226b0e0+10:14751:x1876035752781824:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789127442.542810:0:14761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127442.542825:0:14761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df7bbd97800/0xeeacf7c0243014fe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xeeacf7c0243014f7 expref: -99 pid: 14761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127442.542857:0:14761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df7bbd97800/0xeeacf7c0243014fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xeeacf7c0243014f7 expref: 11 pid: 14761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127442.542869:0:14761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df7bbd97800/0xeeacf7c0243014fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c0243014f7 expref: 11 pid: 14761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127442.542877:0:14761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7bbd97800, rc 0) 00000100:00100000:1.0:1789127442.542908:0:14761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b404ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:396611f1-c34a-4e5a-8396-03624226b0e0+11:14751:x1876035752781824:12345-0@lo:101:mount.lustre.0 Request processed in 129us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127442.542915:0:14761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789127442.543353:0:14751:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6826a6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:14751:1876035752781824:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789127442.543366:0:14751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff8df7aeab6e00/0xeeacf7c0243014f7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c0243014fe expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127442.543375:0:14751:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff8df7aeab6e00/0xeeacf7c0243014f7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xeeacf7c0243014fe expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127442.543422:0:14751:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6826a6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:14751:1876035752781952:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789127442.543450:0:14751:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127442.543478:0:14751:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7869d8e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789127442.543519:0:14761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752781952 00000100:00100000:1.0:1789127442.543523:0:14761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752781952 00000100:00100000:1.0:1789127442.543554:0:14761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789127442.543560:0:14761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b4048850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:396611f1-c34a-4e5a-8396-03624226b0e0+11:14751:x1876035752781952:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789127442.543916:0:14761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b4048850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:396611f1-c34a-4e5a-8396-03624226b0e0+11:14751:x1876035752781952:12345-0@lo:501:mount.lustre.0 Request processed in 354us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127442.543924:0:14761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789127442.544060:0:14751:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6826a6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:14751:1876035752781952:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789127442.544088:0:14751:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6826a6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:14751:1876035752782080:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789127442.544126:0:14751:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127442.544155:0:14751:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7869d8e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789127442.544261:0:14763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752782080 00000100:00100000:0.0:1789127442.544265:0:14763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752782080 00000100:00100000:0.0:1789127442.544297:0:14763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789127442.544304:0:14763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae006850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:396611f1-c34a-4e5a-8396-03624226b0e0+11:14751:x1876035752782080:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789127442.544454:0:14763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae006850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:396611f1-c34a-4e5a-8396-03624226b0e0+11:14751:x1876035752782080:12345-0@lo:503:mount.lustre.0 Request processed in 150us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127442.544463:0:14763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789127442.544581:0:14751:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6826a6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:14751:1876035752782080:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789127442.544907:0:14795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6820bd2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:396611f1-c34a-4e5a-8396-03624226b0e0:14795:1876035752782208:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789127442.544942:0:14795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127442.544971:0:14795:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df786b370c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789127442.545021:0:14764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752782208 00000100:00100000:2.0:1789127442.545025:0:14764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752782208 00000100:00100000:2.0:1789127442.545065:0:14764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789127442.545072:0:14764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae007450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:396611f1-c34a-4e5a-8396-03624226b0e0+11:14795:x1876035752782208:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789127442.545245:0:14764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae007450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:396611f1-c34a-4e5a-8396-03624226b0e0+11:14795:x1876035752782208:12345-0@lo:502:llog_process_th.0 Request processed in 173us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127442.545252:0:14764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789127442.545561:0:14795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6820bd2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:396611f1-c34a-4e5a-8396-03624226b0e0:14795:1876035752782208:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789127442.545584:0:14795:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789127442.545593:0:14795:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127442.545595:0:14795:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789127442.545602:0:14795:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8df7bfc78000 00000020:00000080:1.0:1789127442.545604:0:14795:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789127442.545610:0:14795:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789127442.545613:0:14795:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127442.545614:0:14795:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789127442.545616:0:14795:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789127442.545625:0:14795:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127442.545626:0:14795:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789127442.545630:0:14795:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8df7bfc78000 00000020:00000080:1.0:1789127442.545632:0:14795:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789127442.545687:0:14795:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789127442.545691:0:14795:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127442.545692:0:14795:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789127442.545695:0:14795:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789127442.545697:0:14795:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127442.545699:0:14795:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:1.0:1789127442.545702:0:14795:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8df7bfc78000 00000020:00000080:1.0:1789127442.545704:0:14795:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789127442.545723:0:14795:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789127442.545726:0:14795:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127442.545728:0:14795:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:1.0:1789127442.545731:0:14795:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789127442.545733:0:14795:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127442.545734:0:14795:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789127442.545737:0:14795:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8df7bfc78000 00000020:00000080:1.0:1789127442.545739:0:14795:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789127442.545770:0:14795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae2fb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:396611f1-c34a-4e5a-8396-03624226b0e0:14795:1876035752782336:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789127442.545821:0:14795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127442.545842:0:14795:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df790d42d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789127442.545889:0:14761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752782336 00000100:00100000:0.0:1789127442.545893:0:14761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752782336 00000100:00100000:0.0:1789127442.545925:0:14761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789127442.545932:0:14761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae004c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:396611f1-c34a-4e5a-8396-03624226b0e0+11:14795:x1876035752782336:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789127442.546074:0:14761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae004c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:396611f1-c34a-4e5a-8396-03624226b0e0+11:14795:x1876035752782336:12345-0@lo:502:llog_process_th.0 Request processed in 141us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127442.546081:0:14761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789127442.546242:0:14795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae2fb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:396611f1-c34a-4e5a-8396-03624226b0e0:14795:1876035752782336:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789127442.546261:0:14795:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789127442.546266:0:14795:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127442.546268:0:14795:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1789127442.546271:0:14795:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1789127442.549724:0:14751:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1789127442.549753:0:14751:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789127442.549843:0:14751:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df7aeab6e00/0xeeacf7c0243014f7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c0243014fe expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127442.549854:0:14751:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff8df7aeab6e00/0xeeacf7c0243014f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c0243014fe expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127442.549911:0:14751:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789127442.549914:0:14751:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8df7bfc78000 10000000:01000000:0.0:1789127442.549917:0:14751:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8df7bfc78000 10000000:01000000:0.0:1789127442.549921:0:14751:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789127442.549926:0:14751:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8df7bfc78000 from 1 10000000:01000000:0.0:1789127442.549929:0:14751:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789127442.549963:0:14751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df7ae728200/0xeeacf7c024301505 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127442.549971:0:14751:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff8df7ae728200/0xeeacf7c024301505 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127442.549981:0:14751:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff8df7ae728200/0xeeacf7c024301505 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127442.550003:0:14751:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6820bd2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:14751:1876035752782464:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789127442.550076:0:14751:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127442.550111:0:14751:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7839736c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789127442.550214:0:14763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752782464 00000100:00100000:1.0:1789127442.550221:0:14763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752782464 00000100:00100000:1.0:1789127442.550255:0:14763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789127442.550270:0:14763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae006050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:396611f1-c34a-4e5a-8396-03624226b0e0+11:14751:x1876035752782464:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789127442.550282:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127442.550293:0:14763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df7bbd96800/0xeeacf7c02430150c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xeeacf7c024301505 expref: -99 pid: 14763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127442.550315:0:14763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df7bbd96800/0xeeacf7c02430150c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xeeacf7c024301505 expref: 12 pid: 14763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127442.550333:0:14763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df7bbd96800/0xeeacf7c02430150c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c024301505 expref: 12 pid: 14763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127442.550342:0:14763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7bbd96800, rc 0) 00000100:00100000:1.0:1789127442.550379:0:14763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae006050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:396611f1-c34a-4e5a-8396-03624226b0e0+12:14751:x1876035752782464:12345-0@lo:101:mount.lustre.0 Request processed in 110us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127442.550386:0:14763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789127442.550527:0:14751:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6820bd2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:14751:1876035752782464:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789127442.550540:0:14751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff8df7ae728200/0xeeacf7c024301505 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c02430150c expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127442.550548:0:14751:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff8df7ae728200/0xeeacf7c024301505 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xeeacf7c02430150c expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127442.550591:0:14751:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6820bd2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:14751:1876035752782592:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789127442.550616:0:14751:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127442.550672:0:14751:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7839736c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789127442.556751:0:14764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752782592 00000100:00100000:1.0:1789127442.556763:0:14764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752782592 00000100:00100000:1.0:1789127442.556832:0:14764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789127442.556842:0:14764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae006450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:396611f1-c34a-4e5a-8396-03624226b0e0+12:14751:x1876035752782592:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789127442.557120:0:14764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae006450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:396611f1-c34a-4e5a-8396-03624226b0e0+12:14751:x1876035752782592:12345-0@lo:501:mount.lustre.0 Request processed in 279us (6501us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127442.557128:0:14764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789127442.564267:0:14751:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6820bd2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:14751:1876035752782592:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789127442.564339:0:14751:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6820bd2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:14751:1876035752782720:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789127442.565952:0:14751:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127442.565999:0:14751:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7839736c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789127442.566134:0:14761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752782720 00000100:00100000:2.0:1789127442.566142:0:14761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752782720 00000100:00100000:2.0:1789127442.566196:0:14761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789127442.566213:0:14761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae005c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:396611f1-c34a-4e5a-8396-03624226b0e0+12:14751:x1876035752782720:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789127442.566401:0:14761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae005c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:396611f1-c34a-4e5a-8396-03624226b0e0+12:14751:x1876035752782720:12345-0@lo:503:mount.lustre.0 Request processed in 189us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127442.566409:0:14761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789127442.569352:0:14751:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6820bd2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:14751:1876035752782720:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789127442.569714:0:14800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6820bd2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:396611f1-c34a-4e5a-8396-03624226b0e0:14800:1876035752782848:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789127442.569778:0:14800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127442.569862:0:14800:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7852d6300 going to sleep for 11 seconds 00000100:00100000:1.0:1789127442.571054:0:14763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752782848 00000100:00100000:1.0:1789127442.571062:0:14763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752782848 00000100:00100000:1.0:1789127442.571104:0:14763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789127442.571112:0:14763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae007c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:396611f1-c34a-4e5a-8396-03624226b0e0+12:14800:x1876035752782848:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789127442.571357:0:14763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae007c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:396611f1-c34a-4e5a-8396-03624226b0e0+12:14800:x1876035752782848:12345-0@lo:502:llog_process_th.0 Request processed in 245us (1578us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127442.571372:0:14763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789127442.572458:0:14800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6820bd2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:396611f1-c34a-4e5a-8396-03624226b0e0:14800:1876035752782848:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1789127442.572526:0:14800:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1789127442.572540:0:14800:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8df7af70b490) 00000020:00000080:0.0:1789127442.572559:0:14800:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:0.0:1789127442.572640:0:14800:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8df7bfc78000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1789127442.572645:0:14800:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8df7bfc78000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1789127442.572648:0:14800:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8df7bfc78000 4 00010000:00080000:0.0:1789127442.572683:0:14800:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8df787a80800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.140@tcp at head 00010000:00010000:0.0:1789127442.576777:0:14800:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:0.0:1789127442.581976:0:14800:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1789127442.582018:0:14800:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789127442.582029:0:14800:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xeeacf7c02430151a 00000100:00080000:0.0:1789127442.582303:0:14800:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789127442.582309:0:14800:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8df787a80800 using connection 192.168.206.140@tcp/0@lo 00000100:00100000:0.0:1789127442.582353:0:14800:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df6820bd2c0 x1876035752782976/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789127442.582383:0:14800:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789127442.583144:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6820bd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876035752782976:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789127442.583211:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127442.583959:0:14769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752782976 00000100:00100000:0.0:1789127442.583967:0:14769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752782976 00000100:00100000:0.0:1789127442.583995:0:14769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789127442.584001:0:14769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae2fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3299:x1876035752782976:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789127442.584317:0:14769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae2fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3299:x1876035752782976:12345-0@lo:38:llog_process_th.0 Request processed in 313us (1104us total) trans 0 rc -11/-11 00000100:00100000:0.0:1789127442.584336:0:14769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789127442.584391:0:3299:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789127442.584398:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8df787a80800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789127442.584402:0:3299:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1789127442.584406:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6820bd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876035752782976:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789127442.589872:0:14800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6820bd2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:396611f1-c34a-4e5a-8396-03624226b0e0:14800:1876035752783104:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789127442.589950:0:14800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127442.589985:0:14764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752783104 00000100:00100000:0.0:1789127442.589991:0:14764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752783104 00000100:00100000:0.0:1789127442.590029:0:14764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789127442.590037:0:14764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b5235450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:396611f1-c34a-4e5a-8396-03624226b0e0+12:14800:x1876035752783104:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789127442.590495:0:14764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b5235450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:396611f1-c34a-4e5a-8396-03624226b0e0+12:14800:x1876035752783104:12345-0@lo:502:llog_process_th.0 Request processed in 457us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127442.590503:0:14764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789127442.590547:0:14800:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7852d6f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789127442.590565:0:14800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6820bd2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:396611f1-c34a-4e5a-8396-03624226b0e0:14800:1876035752783104:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789127442.590588:0:14800:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1789127442.590940:0:14751:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1789127442.590958:0:14751:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789127442.590982:0:14751:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df7ae728200/0xeeacf7c024301505 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c02430150c expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127442.590992:0:14751:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff8df7ae728200/0xeeacf7c024301505 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c02430150c expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789127442.591190:0:14751:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789127442.591192:0:14751:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789127442.591193:0:14751:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789127442.591195:0:14751:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789127442.591196:0:14751:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789127442.591197:0:14751:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789127442.591199:0:14751:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789127442.591200:0:14751:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789127442.591202:0:14751:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789127442.591203:0:14751:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789127442.591206:0:14751:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1789127442.591208:0:14751:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789127442.591209:0:14751:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789127442.591211:0:14751:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789127442.591212:0:14751:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789127442.591212:0:14751:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789127442.591214:0:14751:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789127442.591215:0:14751:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789127442.591216:0:14751:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789127442.591216:0:14751:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789127442.591217:0:14751:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789127442.591232:0:14751:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1789127442.591246:0:14751:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae2fa940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:14751:1876035752783232:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789127442.591293:0:14751:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127442.591321:0:14751:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df790d42f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789127442.591372:0:14761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752783232 00000100:00100000:0.0:1789127442.591378:0:14761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752783232 00000100:00100000:0.0:1789127442.591413:0:14761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789127442.591428:0:14761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b5236c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:396611f1-c34a-4e5a-8396-03624226b0e0+12:14751:x1876035752783232:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789127442.591446:0:14761:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1789127442.591457:0:14761:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789127442.652679:0:14761:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789127442.652697:0:14761:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1789127442.652746:0:14785:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789127442.652750:0:14785:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789127442.652771:0:14785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8df7aeab7600/0xeeacf7c024301521 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127442.652819:0:14785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df7bbd96000/0xeeacf7c0243014f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c0243014e9 expref: 12 pid: 14763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127442.652827:0:14785:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8df7aeab7600/0xeeacf7c024301521 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127442.652870:0:14785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df7bbd96000/0xeeacf7c0243014f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xeeacf7c0243014e9 expref: 12 pid: 14763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127442.652883:0:14785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df7bbd96000/0xeeacf7c0243014f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xeeacf7c0243014e9 expref: 12 pid: 14763 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127442.652897:0:14785:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6826a6940 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14785:1876035752783360:0@lo:104: 00000100:00100000:2.0:1789127442.652954:0:14785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127442.652989:0:14785:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df790c8ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1789127442.653116:0:14752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752783360 00000100:00100000:3.0:1789127442.653122:0:14752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752783360 00000100:00100000:3.0:1789127442.653168:0:14752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789127442.653176:0:14752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6826a5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:396611f1-c34a-4e5a-8396-03624226b0e0+3:14785:x1876035752783360:12345-0@lo:104: 00010000:00010000:3.0:1789127442.653199:0:14752:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.140@tcp lock: ffff8df7aeab6200/0xeeacf7c0243014e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xeeacf7c0243014f0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127442.653261:0:14752:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789127442.653267:0:14752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6826a5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:396611f1-c34a-4e5a-8396-03624226b0e0+3:14785:x1876035752783360:12345-0@lo:104: Request processed in 93us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127442.653274:0:14752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1789127442.653309:0:14758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789127442.653316:0:14758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.140@tcp lock: ffff8df7aeab6200/0xeeacf7c0243014e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xeeacf7c0243014f0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127442.653323:0:14758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7aeab6200 already unused, calling callback (ffffffffc1da1c20) 10000000:00010000:3.0:1789127442.653339:0:14758:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.140@tcp lock: ffff8df7aeab6200/0xeeacf7c0243014e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xeeacf7c0243014f0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127442.653348:0:14758:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: ffff8df7aeab6200/0xeeacf7c0243014e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xeeacf7c0243014f0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789127442.653356:0:14758:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: ffff8df7aeab6200/0xeeacf7c0243014e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xeeacf7c0243014f0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127442.653362:0:14758:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789127442.653387:0:14758:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.140@tcp lock: ffff8df7aeab6200/0xeeacf7c0243014e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c0243014f0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127442.653393:0:14758:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789127442.653408:0:14758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.140@tcp lock: ffff8df7aeab6200/0xeeacf7c0243014e9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c0243014f0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127442.653414:0:14758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: ffff8df7aeab6200/0xeeacf7c0243014e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c0243014f0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127442.653429:0:14758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127442.653431:0:14758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127442.653432:0:14758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127442.653614:0:14785:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6826a6940 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14785:1876035752783360:0@lo:104: 00010000:00010000:0.0:1789127442.653632:0:14785:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8df7aeab7600/0xeeacf7c024301521 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127442.654281:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae043840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:396611f1-c34a-4e5a-8396-03624226b0e0:3303:1876035752783488:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789127442.654321:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127442.654541:0:14754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752783488 00000100:00100000:1.0:1789127442.654546:0:14754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752783488 00010000:00010000:1.0:1789127442.654567:0:14754:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df7bbd96000/0xeeacf7c0243014f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xeeacf7c0243014e9 expref: 13 pid: 14763 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127442.654599:0:14754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789127442.654606:0:14754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6826a4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:396611f1-c34a-4e5a-8396-03624226b0e0+13:3303:x1876035752783488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789127442.654616:0:14754:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789127442.654621:0:14754:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df7bbd96000/0xeeacf7c0243014f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xeeacf7c0243014e9 expref: 13 pid: 14763 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127442.654630:0:14754:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df7bbd96000/0xeeacf7c0243014f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xeeacf7c0243014e9 expref: 13 pid: 14763 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127442.654644:0:14754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df7bbd96000/0xeeacf7c0243014f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xeeacf7c0243014e9 expref: 13 pid: 14763 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127442.654657:0:14754:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8df7aeab7600/0xeeacf7c024301521 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127442.654665:0:14754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df7aeab7600/0xeeacf7c024301521 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789127442.654825:0:14754:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002074868s 00010000:00010000:1.0:1789127442.654831:0:14754:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df7aeab7600/0xeeacf7c024301521 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127442.654838:0:14754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df7aeab7600/0xeeacf7c024301521 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127442.654854:0:14754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8df7aeab7600/0xeeacf7c024301521 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127442.654860:0:14754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8df7aeab7600/0xeeacf7c024301521 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127442.654866:0:14754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7aeab7600 already unused, calling callback (ffffffffc17a4550) 00010000:00010000:1.0:1789127442.654870:0:14754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8df7aeab7600/0xeeacf7c024301521 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127442.654878:0:14754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8df7aeab7600/0xeeacf7c024301521 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127442.656148:0:14785:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8df7aeab7600/0xeeacf7c024301521 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127442.656161:0:14785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8df7aeab7600/0xeeacf7c024301521 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127442.656550:0:14754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8df7aeab7600/0xeeacf7c024301521 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127442.656613:0:14754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df7aeab7600/0xeeacf7c024301521 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127442.656633:0:14754:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789127442.656812:0:14754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6826a4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:396611f1-c34a-4e5a-8396-03624226b0e0+12:3303:x1876035752783488:12345-0@lo:103:ldlm_bl.0 Request processed in 2204us (2487us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127442.656822:0:14754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789127442.657347:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae043840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:396611f1-c34a-4e5a-8396-03624226b0e0:3303:1876035752783488:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789127442.661719:0:14761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b5236c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:396611f1-c34a-4e5a-8396-03624226b0e0+11:14751:x1876035752783232:12345-0@lo:253:mount.lustre.0 Request processed in 70285us (70419us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127442.661731:0:14761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789127442.661835:0:14751:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae2fa940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:14751:1876035752783232:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789127442.661849:0:14751:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789127442.661852:0:14751:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789127442.661853:0:14751:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789127442.661854:0:14751:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789127442.661855:0:14751:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789127442.661856:0:14751:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789127442.661857:0:14751:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789127442.661859:0:14751:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789127442.661860:0:14751:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789127442.661861:0:14751:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789127442.661862:0:14751:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789127442.661875:0:14751:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1789127442.668130:0:14751:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1789127442.668480:0:14751:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1789127442.668777:0:14751:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1789127442.669072:0:14751:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1789127442.669476:0:14751:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1789127442.669636:0:14751:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1789127442.670712:0:14751:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1789127442.670904:0:14751:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1789127442.671166:0:14751:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1789127442.671526:0:14751:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1789127442.671775:0:14751:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1789127442.672075:0:14751:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:1.0:1789127442.705663:0:14751:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1789127442.706031:0:14751:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:2.0:1789127442.706305:0:14811:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:2.0:1789127442.706396:0:14811:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:1.0:1789127442.707314:0:14810:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:1.0:1789127442.707320:0:14810:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:3.0:1789127442.710067:0:14751:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1789127442.710192:0:14751:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1789127442.710648:0:14751:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1789127442.710662:0:14751:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1789127442.710813:0:14751:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789127442.712520:0:14811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789127442.712582:0:14811:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1789127442.712586:0:14811:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:3.0:1789127442.713059:0:14751:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1789127442.713723:0:14751:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1789127442.713767:0:14751:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1789127442.714259:0:14751:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 0, last_idx 1 00080000:10000000:3.0:1789127442.718475:0:14751:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:2.0:1789127442.724466:0:14751:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1789127442.754863:0:14751:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1789127442.754898:0:14751:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa7e0415ff988 00100000:10000000:2.0:1789127442.754906:0:14751:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1789127442.755693:0:14751:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789127442.755708:0:14751:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.140@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789127442.755723:0:14751:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1789127442.755741:0:14751:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:2.0:1789127443.188880:0:14757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789127443.637238:0:14801:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789127443.637247:0:14801:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789127443.638133:0:14801:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:3.0:1789127443.638144:0:14801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 10000000:01000000:0.0:1789127444.146940:0:14767:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789127444.146946:0:14767:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8df7bfc78000 from 6 10000000:01000000:0.0:1789127444.146951:0:14767:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789127444.146995:0:14767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df7ae728600/0xeeacf7c024301528 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127444.147016:0:14767:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff8df7ae728600/0xeeacf7c024301528 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127444.147026:0:14767:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff8df7ae728600/0xeeacf7c024301528 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127444.147049:0:14767:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6820bd2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:396611f1-c34a-4e5a-8396-03624226b0e0:14767:1876035752783616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789127444.147114:0:14767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127444.147166:0:14767:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df782bb6780 going to sleep for 11 seconds 00000100:00100000:3.0:1789127444.147228:0:14763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752783616 00000100:00100000:3.0:1789127444.147236:0:14763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752783616 00000100:00100000:3.0:1789127444.147301:0:14763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789127444.147311:0:14763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b5236850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:396611f1-c34a-4e5a-8396-03624226b0e0+11:14767:x1876035752783616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789127444.147335:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127444.147349:0:14763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df7c2051200/0xeeacf7c02430152f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xeeacf7c024301528 expref: -99 pid: 14763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127444.147370:0:14763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df7c2051200/0xeeacf7c02430152f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xeeacf7c024301528 expref: 12 pid: 14763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127444.147380:0:14763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df7c2051200/0xeeacf7c02430152f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c024301528 expref: 12 pid: 14763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127444.147389:0:14763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7c2051200, rc 0) 00000100:00100000:3.0:1789127444.147431:0:14763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b5236850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:396611f1-c34a-4e5a-8396-03624226b0e0+12:14767:x1876035752783616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127444.147438:0:14763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789127444.147481:0:14767:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6820bd2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:396611f1-c34a-4e5a-8396-03624226b0e0:14767:1876035752783616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789127444.147501:0:14767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff8df7ae728600/0xeeacf7c024301528 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c02430152f expref: -99 pid: 14767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127444.147509:0:14767:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff8df7ae728600/0xeeacf7c024301528 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xeeacf7c02430152f expref: -99 pid: 14767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127444.147554:0:14767:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae041680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:396611f1-c34a-4e5a-8396-03624226b0e0:14767:1876035752783744:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789127444.147596:0:14767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127444.147611:0:14767:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df786973240 going to sleep for 11 seconds 00000100:00100000:3.0:1789127444.147622:0:14761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752783744 00000100:00100000:3.0:1789127444.147626:0:14761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752783744 00000100:00100000:3.0:1789127444.147647:0:14761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789127444.147653:0:14761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b5235c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:396611f1-c34a-4e5a-8396-03624226b0e0+12:14767:x1876035752783744:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789127444.147665:0:14761:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789127444.147679:0:14761:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789127444.147682:0:14761:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1789127444.147756:0:14761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b5235c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:396611f1-c34a-4e5a-8396-03624226b0e0+12:14767:x1876035752783744:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 102us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127444.147763:0:14761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789127444.147824:0:14767:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae041680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:396611f1-c34a-4e5a-8396-03624226b0e0:14767:1876035752783744:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789127444.147865:0:14767:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789127444.147871:0:14767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df7ae728600/0xeeacf7c024301528 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c02430152f expref: -99 pid: 14767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127444.147879:0:14767:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff8df7ae728600/0xeeacf7c024301528 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c02430152f expref: -99 pid: 14767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127444.211941:0:14758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789127444.659240:0:14801:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789127444.659247:0:14801:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789127444.659278:0:14801:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:0.0:1789127444.659286:0:14801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1789127445.237995:0:14757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127446.261938:0:14758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789127447.252975:0:15054:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789127447.283391:0:14757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789127448.057009:0:14317:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789127448.057015:0:14317:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789127448.057017:0:14317:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789127448.057021:0:14317:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789127448.057023:0:14317:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1789127448.057026:0:14317:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789127448.057030:0:14317:0:(import.c:65:import_set_state_nolock()) ffff8df787a80800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789127448.057040:0:14317:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8df787a80800 using connection 192.168.206.140@tcp/0@lo 00000100:00100000:2.0:1789127448.057061:0:14317:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df6826a7840 x1876035752784000/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789127448.057196:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6826a4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:396611f1-c34a-4e5a-8396-03624226b0e0:3300:1876035752783872:0@lo:400:kworker.0 00000100:00100000:2.0:1789127448.057267:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127448.058914:0:14761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752783872 00000100:00100000:3.0:1789127448.058924:0:14761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752783872 00000100:00100000:3.0:1789127448.058976:0:14761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789127448.058985:0:14761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b5236450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:396611f1-c34a-4e5a-8396-03624226b0e0+12:3300:x1876035752783872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127448.059060:0:14761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b5236450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:396611f1-c34a-4e5a-8396-03624226b0e0+12:3300:x1876035752783872:12345-0@lo:400:kworker.0 Request processed in 76us (1792us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127448.059067:0:14761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789127448.059314:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6826a7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876035752784000:0@lo:38:kworker.0 00000100:00100000:1.0:1789127448.069901:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127448.073989:0:14771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752784000 00000100:00100000:0.0:1789127448.074002:0:14771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752784000 00000100:00100000:0.0:1789127448.074048:0:14771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789127448.074056:0:14771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae2fa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3299:x1876035752784000:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1789127448.074086:0:14771:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 394 last 0 00000020:00000080:0.0:1789127448.074133:0:14771:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xeeacf7c024301536 00000004:00100000:0.0:1789127448.074148:0:14771:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789127448.074289:0:14771:0:(import.c:65:import_set_state_nolock()) ffff8df787a85800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789127448.074379:0:14771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae2fa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876035752784000:12345-0@lo:38:kworker.0 Request processed in 321us (4484us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127448.074386:0:14771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789127448.074607:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8df6826a7840 x1876035752784000/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789127458 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789127448.074623:0:3299:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1789127448.074630:0:3299:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1789127448.074635:0:3299:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789127448.074637:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8df787a80800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789127448.074643:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6826a7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876035752784000:0@lo:38:kworker.0 00000100:00100000:3.0:1789127448.080557:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6826a4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:396611f1-c34a-4e5a-8396-03624226b0e0:3300:1876035752783872:0@lo:400:kworker.0 00010000:00010000:3.0:1789127448.308524:0:14758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127449.330972:0:14757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789127449.952597:0:15204:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdcbf848b0 20000000:00000080:3.0:1789127449.952613:0:15204:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8df7b5ebe800 uarg=0000000000000000 20000000:01000000:3.0:1789127449.952644:0:15204:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1789127449.952651:0:15204:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1789127449.952655:0:15204:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1789127449.953605:0:15205:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:3.0:1789127449.954514:0:15204:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1789127449.967977:0:15204:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789127449.968472:0:15204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8df7aeab7200/0xeeacf7c02430153d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.968493:0:15204:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df7bbd97800/0xeeacf7c0243014fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c0243014f7 expref: 11 pid: 14761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.968501:0:15204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8df7aeab7200/0xeeacf7c02430153d lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.968547:0:15204:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df7bbd97800/0xeeacf7c0243014fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xeeacf7c0243014f7 expref: 11 pid: 14761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.968561:0:15204:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df7bbd97800/0xeeacf7c0243014fe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xeeacf7c0243014f7 expref: 11 pid: 14761 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127449.968575:0:15204:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6826a6580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:15204:1876035752784128:0@lo:104: 00000100:00100000:2.0:1789127449.968635:0:15204:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127449.968731:0:15204:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df78802a480 going to sleep for 11 seconds 00000100:00100000:1.0:1789127449.969458:0:14753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752784128 00000100:00100000:1.0:1789127449.969466:0:14753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752784128 00000100:00100000:1.0:1789127449.969552:0:14753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789127449.969562:0:14753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6826a6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:396611f1-c34a-4e5a-8396-03624226b0e0+3:15204:x1876035752784128:12345-0@lo:104: 00010000:00010000:1.0:1789127449.969576:0:14753:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.140@tcp lock: ffff8df7aeab6e00/0xeeacf7c0243014f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xeeacf7c0243014fe expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127449.969663:0:14753:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789127449.969670:0:14753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6826a6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:396611f1-c34a-4e5a-8396-03624226b0e0+3:15204:x1876035752784128:12345-0@lo:104: Request processed in 110us (1035us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127449.969678:0:14753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1789127449.969722:0:14758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789127449.969730:0:14758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.140@tcp lock: ffff8df7aeab6e00/0xeeacf7c0243014f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xeeacf7c0243014fe expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127449.969737:0:14758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7aeab6e00 already unused, calling callback (ffffffffc1da1c20) 10000000:00010000:0.0:1789127449.969742:0:14758:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.140@tcp lock: ffff8df7aeab6e00/0xeeacf7c0243014f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xeeacf7c0243014fe expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127449.969751:0:14758:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: ffff8df7aeab6e00/0xeeacf7c0243014f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xeeacf7c0243014fe expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789127449.969759:0:14758:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: ffff8df7aeab6e00/0xeeacf7c0243014f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xeeacf7c0243014fe expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127449.969765:0:14758:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789127449.969844:0:14758:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.140@tcp lock: ffff8df7aeab6e00/0xeeacf7c0243014f7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c0243014fe expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127449.969851:0:14758:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789127449.969872:0:14758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.140@tcp lock: ffff8df7aeab6e00/0xeeacf7c0243014f7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c0243014fe expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127449.969879:0:14758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: ffff8df7aeab6e00/0xeeacf7c0243014f7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c0243014fe expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127449.969893:0:14758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127449.969895:0:14758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127449.969897:0:14758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127449.971474:0:15204:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6826a6580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:15204:1876035752784128:0@lo:104: 00010000:00010000:2.0:1789127449.971501:0:15204:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8df7aeab7200/0xeeacf7c02430153d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127449.973278:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6820bf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:396611f1-c34a-4e5a-8396-03624226b0e0:3301:1876035752784256:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789127449.973362:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127449.973543:0:14755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752784256 00000100:00100000:2.0:1789127449.973550:0:14755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752784256 00010000:00010000:2.0:1789127449.973582:0:14755:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df7bbd97800/0xeeacf7c0243014fe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xeeacf7c0243014f7 expref: 12 pid: 14761 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127449.973620:0:14755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789127449.973629:0:14755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae040780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:396611f1-c34a-4e5a-8396-03624226b0e0+12:3301:x1876035752784256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789127449.973643:0:14755:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789127449.973662:0:14755:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df7bbd97800/0xeeacf7c0243014fe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xeeacf7c0243014f7 expref: 12 pid: 14761 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.973673:0:14755:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df7bbd97800/0xeeacf7c0243014fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xeeacf7c0243014f7 expref: 12 pid: 14761 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.973690:0:14755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df7bbd97800/0xeeacf7c0243014fe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xeeacf7c0243014f7 expref: 12 pid: 14761 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.973705:0:14755:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8df7aeab7200/0xeeacf7c02430153d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 15204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.973713:0:14755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df7aeab7200/0xeeacf7c02430153d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 15204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.973727:0:14755:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df7aeab7200/0xeeacf7c02430153d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.973734:0:14755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df7aeab7200/0xeeacf7c02430153d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.973742:0:14755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8df7aeab7200/0xeeacf7c02430153d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.973748:0:14755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8df7aeab7200/0xeeacf7c02430153d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.973755:0:14755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7aeab7200 already unused, calling callback (ffffffffc17a4550) 00010000:00010000:2.0:1789127449.973759:0:14755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8df7aeab7200/0xeeacf7c02430153d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.973768:0:14755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8df7aeab7200/0xeeacf7c02430153d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.973819:0:14755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8df7aeab7200/0xeeacf7c02430153d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.973829:0:14755:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789127449.973871:0:14755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae040780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:396611f1-c34a-4e5a-8396-03624226b0e0+11:3301:x1876035752784256:12345-0@lo:103:ldlm_bl.0 Request processed in 242us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127449.973878:0:14755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789127449.973911:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6820bf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:396611f1-c34a-4e5a-8396-03624226b0e0:3301:1876035752784256:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789127449.974060:0:15204:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8df7aeab7200/0xeeacf7c02430153d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127449.974080:0:15204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8df7aeab7200/0xeeacf7c02430153d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127449.974093:0:15204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df7aeab7200/0xeeacf7c02430153d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127450.360064:0:14757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127451.379092:0:14758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789127451.699459:0:14767:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789127451.699467:0:14767:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df7bfc78000 from 13 10000000:01000000:0.0:1789127451.699473:0:14767:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789127451.699534:0:14767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df7ae728a00/0xeeacf7c024301544 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127451.699545:0:14767:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff8df7ae728a00/0xeeacf7c024301544 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127451.699556:0:14767:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff8df7ae728a00/0xeeacf7c024301544 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127451.699581:0:14767:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6820bd680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:396611f1-c34a-4e5a-8396-03624226b0e0:14767:1876035752784384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789127451.699651:0:14767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127451.699704:0:14767:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df787b713c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789127451.701579:0:14764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752784384 00000100:00100000:3.0:1789127451.701592:0:14764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752784384 00000100:00100000:3.0:1789127451.701658:0:14764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789127451.701669:0:14764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b5234c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:396611f1-c34a-4e5a-8396-03624226b0e0+11:14767:x1876035752784384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789127451.701685:0:14764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127451.701704:0:14764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df7c2051e00/0xeeacf7c02430154b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xeeacf7c024301544 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127451.701731:0:14764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df7c2051e00/0xeeacf7c02430154b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xeeacf7c024301544 expref: 12 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127451.701742:0:14764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df7c2051e00/0xeeacf7c02430154b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c024301544 expref: 12 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127451.701751:0:14764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7c2051e00, rc 0) 00000100:00100000:3.0:1789127451.701841:0:14764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b5234c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:396611f1-c34a-4e5a-8396-03624226b0e0+12:14767:x1876035752784384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 174us (2190us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127451.701849:0:14764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789127451.702059:0:14767:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6820bd680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:396611f1-c34a-4e5a-8396-03624226b0e0:14767:1876035752784384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789127451.702078:0:14767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff8df7ae728a00/0xeeacf7c024301544 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c02430154b expref: -99 pid: 14767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127451.702087:0:14767:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff8df7ae728a00/0xeeacf7c024301544 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xeeacf7c02430154b expref: -99 pid: 14767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127451.702151:0:14767:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6820bd680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:396611f1-c34a-4e5a-8396-03624226b0e0:14767:1876035752784512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789127451.702186:0:14767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127451.702211:0:14767:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df787b713c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789127451.702435:0:14763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752784512 00000100:00100000:3.0:1789127451.702440:0:14763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752784512 00000100:00100000:3.0:1789127451.702474:0:14763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789127451.702481:0:14763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b5237c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:396611f1-c34a-4e5a-8396-03624226b0e0+12:14767:x1876035752784512:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789127451.702720:0:14763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b5237c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:396611f1-c34a-4e5a-8396-03624226b0e0+12:14767:x1876035752784512:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 238us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127451.702734:0:14763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789127451.703454:0:14767:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6820bd680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:396611f1-c34a-4e5a-8396-03624226b0e0:14767:1876035752784512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789127451.703498:0:14767:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6820bd680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:396611f1-c34a-4e5a-8396-03624226b0e0:14767:1876035752784640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789127451.703550:0:14767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127451.703577:0:14767:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df787b713c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789127451.704628:0:14761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752784640 00000100:00100000:3.0:1789127451.704637:0:14761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752784640 00000100:00100000:3.0:1789127451.704687:0:14761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789127451.704697:0:14761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b5236050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:396611f1-c34a-4e5a-8396-03624226b0e0+12:14767:x1876035752784640:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789127451.704909:0:14761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b5236050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:396611f1-c34a-4e5a-8396-03624226b0e0+12:14767:x1876035752784640:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 213us (1358us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127451.704918:0:14761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789127451.705139:0:14767:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6820bd680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:396611f1-c34a-4e5a-8396-03624226b0e0:14767:1876035752784640:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789127451.707369:0:15273:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1789127451.707489:0:14767:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1789127451.707516:0:14767:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789127451.707526:0:14767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df7ae728a00/0xeeacf7c024301544 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c02430154b expref: -99 pid: 14767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127451.707537:0:14767:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff8df7ae728a00/0xeeacf7c024301544 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c02430154b expref: -99 pid: 14767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127452.147858:0:3299:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789127442/real 1789127442] req@ffff8df7ae2f8b40 x1876035752781312/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789127452 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127452.147888:0:3299:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8df7ae2f8b40 x1876035752781312/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789127452 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127452.147898:0:3299:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789127442/real 1789127442] req@ffff8df7ae2f9e00 x1876035752781184/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789127452 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127452.147909:0:3299:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8df7ae2f9e00 x1876035752781184/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789127452 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789127452.147924:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8df7bb5d1800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789127452.147950:0:3299:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789127452.147953:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae2f8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1876035752781312:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1789127452.147959:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8df78803a800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789127452.147964:0:3299:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789127452.147966:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae2f9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1876035752781184:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1789127452.148025:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789127452.148029:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1789127452.148031:0:8:0:(import.c:65:import_set_state_nolock()) ffff8df78803a800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789127452.148035:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 388 00000100:00080000:3.0:1789127452.148040:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789127452.148044:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8df78803a800 using connection 192.168.206.140@tcp/0@lo 00000100:00100000:3.0:1789127452.148059:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df7ae0430c0 x1876035752784896/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789127452.148071:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789127452.148074:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789127452.148075:0:8:0:(import.c:65:import_set_state_nolock()) ffff8df7bb5d1800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789127452.148078:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 388 00000100:00080000:3.0:1789127452.148080:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789127452.148083:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8df7bb5d1800 using connection 192.168.206.140@tcp/0@lo 00000100:00100000:3.0:1789127452.148090:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df7ae043480 x1876035752785024/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789127452.148115:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae042d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:396611f1-c34a-4e5a-8396-03624226b0e0:3302:1876035752784768:0@lo:400:kworker.0 00000100:00100000:3.0:1789127452.148170:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127452.148209:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789127452.148221:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae041a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876035752785152:0@lo:400:kworker.0 00000100:00100000:3.0:1789127452.148260:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127452.148304:0:14764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752784768 00000100:00100000:3.0:1789127452.148310:0:14764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752784768 00000100:00100000:3.0:1789127452.148348:0:14764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789127452.148356:0:14764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b5237450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:396611f1-c34a-4e5a-8396-03624226b0e0+12:3302:x1876035752784768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127452.148400:0:14764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b5237450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:396611f1-c34a-4e5a-8396-03624226b0e0+12:3302:x1876035752784768:12345-0@lo:400:kworker.0 Request processed in 45us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127452.148408:0:14764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789127452.148449:0:14770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752785152 00000100:00100000:3.0:1789127452.148453:0:14770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752785152 00000100:00100000:3.0:1789127452.148494:0:14770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789127452.148501:0:14770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae0412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876035752785152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127452.148534:0:14770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae0412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876035752785152:12345-0@lo:400:kworker.0 Request processed in 35us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127452.148540:0:14770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789127452.148563:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae0430c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1876035752784896:0@lo:8:kworker.0 00000400:00000100:3.0:1789127452.148601:0:3299:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876035752784896 offset 0 length 520: 4 00000100:00100000:3.0:1789127452.148615:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae043480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1876035752785024:0@lo:8:kworker.0 00000400:00000100:3.0:1789127452.148658:0:3299:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876035752785024 offset 0 length 520: 4 00010000:00080000:3.0:1789127452.148696:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8df7ae041a40 x1876035752785152/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127468 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127452.148707:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae041a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876035752785152:0@lo:400:kworker.0 00000100:00100000:3.0:1789127452.148715:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae042d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:396611f1-c34a-4e5a-8396-03624226b0e0:3302:1876035752784768:0@lo:400:kworker.0 00010000:00010000:1.0:1789127452.404857:0:14757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127453.433535:0:14758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127454.451147:0:14757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789127454.902001:0:14801:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789127454.902011:0:14801:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789127454.903206:0:14801:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1789127454.903314:0:14801:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789127454.903345:0:14801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 1 count 1 00000020:01000004:0.0:1789127455.441082:0:15453:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789127455.441086:0:15453:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1789127455.441209:0:15453:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8df682b8a000 00000020:01000004:0.0:1789127455.441224:0:15453:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1789127455.441311:0:15453:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1789127455.441325:0:15453:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8df7af708000) 00000020:00000080:0.0:1789127455.441338:0:15453:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789127455.467502:0:15453:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789127455.468778:0:15453:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1789127455.471308:0:15453:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1789127455.472703:0:15453:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1789127455.473165:0:15453:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1789127455.474273:0:15453:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 377: rc = 0 00100000:10000000:3.0:1789127455.474449:0:15453:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 377: rc = 0 00100000:10000000:3.0:1789127455.475326:0:15453:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 377: rc = 0 00100000:10000000:3.0:1789127455.477656:0:15453:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 593: rc = 0 00100000:10000000:3.0:1789127455.478331:0:15453:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 593: rc = 0 00100000:10000000:3.0:1789127455.478915:0:15453:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 593: rc = 0 00100000:10000000:3.0:1789127455.479784:0:15453:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 593: rc = 0 00100000:10000000:3.0:1789127455.481882:0:15453:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 593: rc = 0 00010000:00010000:0.0:1789127455.483137:0:14758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1789127455.484709:0:15453:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 593: rc = 0 00000020:00000080:3.0:1789127455.488740:0:15453:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1789127455.488753:0:15453:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789127455.488766:0:15453:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xeeacf7c024301559 00000020:01000004:3.0:1789127455.488774:0:15453:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1789127455.488822:0:15453:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.140@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789127455.488826:0:15453:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.140@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789127455.488891:0:15453:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1789127455.488896:0:15453:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1789127455.488911:0:15453:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8df7881dced8) 00000020:00000080:3.0:1789127455.488925:0:15453:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:3.0:1789127455.492003:0:15453:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789127455.495700:0:15453:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1789127455.495709:0:15453:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1789127455.497138:0:15453:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1789127455.497148:0:15453:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1789127455.501679:0:15453:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1789127455.501689:0:15453:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1789127455.504161:0:15453:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789127455.504612:0:15453:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1789127455.504619:0:15453:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1789127455.505398:0:15453:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1789127455.505408:0:15453:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1789127455.542721:0:15453:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789127455.542980:0:15453:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789127455.542986:0:15453:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1789127455.544995:0:15453:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789127455.545005:0:15453:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1789127455.547191:0:15453:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789127455.547204:0:15453:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1789127455.551366:0:15453:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789127455.551620:0:15453:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1789127455.551628:0:15453:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1789127455.552463:0:15453:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1789127455.552471:0:15453:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1789127455.608869:0:15453:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789127455.609082:0:15453:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1789127455.609089:0:15453:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1789127455.610555:0:15453:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1789127455.610566:0:15453:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1789127455.612637:0:15453:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1789127455.612662:0:15453:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1789127455.612667:0:15453:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.140@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1789127455.629819:0:15453:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.140@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789127455.629854:0:15453:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.140@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1789127455.629858:0:15453:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789127455.629860:0:15453:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789127455.629861:0:15453:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789127455.629862:0:15453:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789127455.629864:0:15453:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789127455.629865:0:15453:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789127455.629866:0:15453:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789127455.629868:0:15453:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789127455.629869:0:15453:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789127455.629876:0:15453:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1789127455.629879:0:15453:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789127455.629880:0:15453:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789127455.629881:0:15453:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789127455.629882:0:15453:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789127455.629883:0:15453:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789127455.629884:0:15453:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789127455.629885:0:15453:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789127455.629886:0:15453:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789127455.629887:0:15453:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789127455.629910:0:15453:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1789127455.629928:0:15453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6820bf0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:15453:1876035752785280:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789127455.630524:0:15453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127455.630650:0:15453:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df786bae840 going to sleep for 11 seconds 00000100:00100000:3.0:1789127455.634064:0:14763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752785280 00000100:00100000:3.0:1789127455.634078:0:14763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752785280 00000100:00100000:3.0:1789127455.634157:0:14763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789127455.634167:0:14763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b5234450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:396611f1-c34a-4e5a-8396-03624226b0e0+12:15453:x1876035752785280:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789127455.634217:0:14763:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1789127455.634221:0:14763:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1789127455.634347:0:14763:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1789127455.677765:0:14763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b5234450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:396611f1-c34a-4e5a-8396-03624226b0e0+12:15453:x1876035752785280:12345-0@lo:253:mount.lustre.0 Request processed in 43592us (47235us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127455.677780:0:14763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789127455.677918:0:15453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6820bf0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:15453:1876035752785280:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789127455.677934:0:15453:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1789127455.677938:0:15453:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789127455.677940:0:15453:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789127455.677941:0:15453:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789127455.677942:0:15453:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789127455.677944:0:15453:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789127455.677945:0:15453:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789127455.677947:0:15453:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789127455.677949:0:15453:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789127455.677950:0:15453:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789127455.677971:0:15453:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8df682b8a000 from lustre-OST0000 10000000:01000000:0.0:1789127455.677994:0:15453:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1789127455.677998:0:15453:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1789127455.678004:0:15453:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8df790230000 local copy 00010000:00010000:0.0:1789127455.678014:0:15453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df7c2050c00/0xeeacf7c02430144f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c024301456 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127455.678270:0:15453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6820bf0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:15453:1876035752785408:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789127455.678310:0:15453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127455.678359:0:15453:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df786baed80 going to sleep for 11 seconds 00000100:00100000:3.0:1789127455.678759:0:14761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752785408 00000100:00100000:3.0:1789127455.678766:0:14761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752785408 00000100:00100000:3.0:1789127455.678827:0:14761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789127455.678835:0:14761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b5237850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:396611f1-c34a-4e5a-8396-03624226b0e0+12:15453:x1876035752785408:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789127455.679021:0:14761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b5237850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:396611f1-c34a-4e5a-8396-03624226b0e0+12:15453:x1876035752785408:12345-0@lo:501:mount.lustre.0 Request processed in 186us (710us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789127455.679028:0:14761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789127455.679353:0:15453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6820bf0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:15453:1876035752785408:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1789127455.679376:0:15453:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.140@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789127455.679629:0:15453:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.140@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789127455.679637:0:15453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df7c2050c00/0xeeacf7c02430144f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c024301456 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127455.679659:0:15453:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff8df7c2050c00/0xeeacf7c02430144f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c024301456 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127455.679688:0:15453:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8df682b8a000 10000000:01000000:2.0:1789127455.679693:0:15453:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789127455.679698:0:15453:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8df790230000 10000000:01000000:2.0:1789127455.679701:0:15453:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1789127455.679704:0:15453:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8df790230000 from 1 10000000:01000000:2.0:1789127455.679707:0:15453:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789127455.679736:0:15453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df7aeab7400/0xeeacf7c024301567 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127455.679745:0:15453:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff8df7aeab7400/0xeeacf7c024301567 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127455.679754:0:15453:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff8df7aeab7400/0xeeacf7c024301567 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127455.679773:0:15453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6826a43c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:15453:1876035752785536:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789127455.679852:0:15453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127455.679890:0:15453:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df784d46600 going to sleep for 11 seconds 00000100:00100000:3.0:1789127455.679953:0:14763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752785536 00000100:00100000:3.0:1789127455.679959:0:14763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752785536 00000100:00100000:3.0:1789127455.679995:0:14763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789127455.680003:0:14763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b5234850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:396611f1-c34a-4e5a-8396-03624226b0e0+12:15453:x1876035752785536:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789127455.680012:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127455.680024:0:14763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df7c2050200/0xeeacf7c02430156e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xeeacf7c024301567 expref: -99 pid: 14763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.680044:0:14763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df7c2050200/0xeeacf7c02430156e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xeeacf7c024301567 expref: 13 pid: 14763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.680054:0:14763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df7c2050200/0xeeacf7c02430156e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c024301567 expref: 13 pid: 14763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.680073:0:14763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7c2050200, rc 0) 00000100:00100000:3.0:1789127455.680105:0:14763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b5234850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:396611f1-c34a-4e5a-8396-03624226b0e0+13:15453:x1876035752785536:12345-0@lo:101:mount.lustre.0 Request processed in 102us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127455.680111:0:14763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789127455.680501:0:15453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6826a43c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:15453:1876035752785536:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789127455.680515:0:15453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff8df7aeab7400/0xeeacf7c024301567 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c02430156e expref: -99 pid: 15453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.680524:0:15453:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff8df7aeab7400/0xeeacf7c024301567 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xeeacf7c02430156e expref: -99 pid: 15453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127455.680610:0:15453:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789127455.680626:0:15453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df7aeab7400/0xeeacf7c024301567 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c02430156e expref: -99 pid: 15453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.680633:0:15453:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff8df7aeab7400/0xeeacf7c024301567 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c02430156e expref: -99 pid: 15453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127455.680640:0:15453:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1789127455.680644:0:15453:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789127455.680649:0:15453:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1789127455.680650:0:15453:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789127455.680669:0:15453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df7ae729600/0xeeacf7c024301575 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.680675:0:15453:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff8df7ae729600/0xeeacf7c024301575 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.680682:0:15453:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff8df7ae729600/0xeeacf7c024301575 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127455.680695:0:15453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6820bed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:15453:1876035752785664:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789127455.680727:0:15453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127455.680761:0:15453:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df786baec00 going to sleep for 11 seconds 00000100:00100000:2.0:1789127455.680850:0:14764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752785664 00000100:00100000:2.0:1789127455.680855:0:14764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752785664 00000100:00100000:2.0:1789127455.680887:0:14764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789127455.680893:0:14764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b5237050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:396611f1-c34a-4e5a-8396-03624226b0e0+13:15453:x1876035752785664:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789127455.680901:0:14764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127455.680910:0:14764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df7aeab7600/0xeeacf7c02430157c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xeeacf7c024301575 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127455.680935:0:14764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df7aeab7600/0xeeacf7c02430157c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xeeacf7c024301575 expref: 14 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127455.680943:0:14764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df7aeab7600/0xeeacf7c02430157c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c024301575 expref: 14 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127455.680951:0:14764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7aeab7600, rc 0) 00000100:00100000:2.0:1789127455.680991:0:14764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b5237050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:396611f1-c34a-4e5a-8396-03624226b0e0+14:15453:x1876035752785664:12345-0@lo:101:mount.lustre.0 Request processed in 97us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127455.680997:0:14764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789127455.681101:0:15453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6820bed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:15453:1876035752785664:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789127455.681111:0:15453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff8df7ae729600/0xeeacf7c024301575 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c02430157c expref: -99 pid: 15453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.681118:0:15453:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff8df7ae729600/0xeeacf7c024301575 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xeeacf7c02430157c expref: -99 pid: 15453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789127455.681928:0:15453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1789127455.684736:0:15453:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789127455.685021:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1789127455.685063:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1789127455.685093:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1789127455.685135:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1789127455.685183:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1789127455.685213:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1789127455.685352:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1789127455.685360:0:15453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1789127455.685437:0:15453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6820bed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:15453:1876035752785792:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789127455.685495:0:15453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127455.685656:0:15453:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df786baec00 going to sleep for 11 seconds 00000100:00100000:2.0:1789127455.685725:0:14761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752785792 00000100:00100000:2.0:1789127455.685731:0:14761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752785792 00000100:00100000:2.0:1789127455.685814:0:14761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789127455.685823:0:14761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b5235050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:396611f1-c34a-4e5a-8396-03624226b0e0+14:15453:x1876035752785792:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789127455.686119:0:14761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b5235050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:396611f1-c34a-4e5a-8396-03624226b0e0+14:15453:x1876035752785792:12345-0@lo:501:mount.lustre.0 Request processed in 297us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127455.686127:0:14761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789127455.686213:0:15453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6820bed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:15453:1876035752785792:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789127455.686269:0:15453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae2fad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:15453:1876035752785920:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789127455.686305:0:15453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127455.686542:0:15453:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df786973240 going to sleep for 11 seconds 00000100:00100000:0.0:1789127455.686675:0:14764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752785920 00000100:00100000:0.0:1789127455.686680:0:14764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752785920 00000100:00100000:0.0:1789127455.686703:0:14764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789127455.686709:0:14764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b5235850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:396611f1-c34a-4e5a-8396-03624226b0e0+14:15453:x1876035752785920:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789127455.687001:0:14764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b5235850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:396611f1-c34a-4e5a-8396-03624226b0e0+14:15453:x1876035752785920:12345-0@lo:503:mount.lustre.0 Request processed in 291us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127455.687008:0:14764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789127455.687082:0:15453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae2fad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:15453:1876035752785920:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789127455.687685:0:15453:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789127455.687763:0:15453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae2fad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:15453:1876035752786048:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789127455.687844:0:15453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127455.687874:0:15453:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df786973240 going to sleep for 11 seconds 00000100:00100000:0.0:1789127455.688085:0:14764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752786048 00000100:00100000:0.0:1789127455.688097:0:14764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752786048 00000100:00100000:0.0:1789127455.688124:0:14764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789127455.688131:0:14764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b5234050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:396611f1-c34a-4e5a-8396-03624226b0e0+14:15453:x1876035752786048:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789127455.688322:0:14764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b5234050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:396611f1-c34a-4e5a-8396-03624226b0e0+14:15453:x1876035752786048:12345-0@lo:502:mount.lustre.0 Request processed in 191us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127455.688329:0:14764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789127455.688709:0:15453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae2fad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:15453:1876035752786048:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789127455.688952:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1789127455.689003:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1789127455.689035:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1789127455.689093:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1789127455.689126:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1789127455.689159:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1789127455.689205:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1789127455.689370:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1789127455.689410:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:1.0:1789127455.689475:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:1.0:1789127455.689515:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:1.0:1789127455.689637:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:1.0:1789127455.689670:0:15453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae2fad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:15453:1876035752786176:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789127455.689721:0:15453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127455.689845:0:15453:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df786973240 going to sleep for 11 seconds 00000100:00100000:2.0:1789127455.689971:0:14761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752786176 00000100:00100000:2.0:1789127455.689977:0:14761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752786176 00000100:00100000:2.0:1789127455.690011:0:14761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789127455.690017:0:14761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b5666c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:396611f1-c34a-4e5a-8396-03624226b0e0+14:15453:x1876035752786176:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789127455.690219:0:14761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b5666c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:396611f1-c34a-4e5a-8396-03624226b0e0+14:15453:x1876035752786176:12345-0@lo:502:mount.lustre.0 Request processed in 201us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127455.690234:0:14761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789127455.690378:0:15453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae2fad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:15453:1876035752786176:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789127455.690434:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:1.0:1789127455.690443:0:15453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:3.0:1789127455.691500:0:15468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789127455.691508:0:15468:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1789127455.691514:0:15468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127455.691516:0:15468:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1789127455.691521:0:15468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789127455.691598:0:15468:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8df7881d9a48) 00000020:00000080:3.0:1789127455.691616:0:15468:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789127455.691621:0:15468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789127455.691683:0:15468:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8df682b8a000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1789127455.691690:0:15468:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789127455.691696:0:15468:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xeeacf7c02430158a 00010000:00010000:3.0:1789127455.695119:0:15468:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:3.0:1789127455.695656:0:15468:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:3.0:1789127455.697332:0:15468:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00000020:00000080:1.0:1789127455.698873:0:15468:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1789127455.698885:0:15468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789127455.698890:0:15468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127455.698892:0:15468:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1789127455.698896:0:15468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789127455.698899:0:15468:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:1.0:1789127455.698900:0:15468:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789127455.698902:0:15468:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789127455.698903:0:15468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789127455.698906:0:15468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127455.698907:0:15468:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789127455.698910:0:15468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789127455.698913:0:15468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127455.698915:0:15468:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789127455.698918:0:15468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789127455.698919:0:15468:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789127455.698921:0:15468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789127455.698930:0:15468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127455.698932:0:15468:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789127455.698935:0:15468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789127455.698937:0:15468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127455.698938:0:15468:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789127455.698941:0:15468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1789127455.698976:0:15468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789127455.698980:0:15468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127455.698981:0:15468:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789127455.698984:0:15468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:2.0:1789127455.699238:0:15453:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1789127455.699278:0:15453:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1789127455.699336:0:15453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df7ae729600/0xeeacf7c024301575 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c02430157c expref: -99 pid: 15453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127455.699347:0:15453:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff8df7ae729600/0xeeacf7c024301575 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c02430157c expref: -99 pid: 15453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127455.699355:0:15453:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df682b8a000 from 1 10000000:01000000:2.0:1789127455.699358:0:15453:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789127455.699389:0:15453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df7aeab6200/0xeeacf7c024301591 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127455.699399:0:15453:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff8df7aeab6200/0xeeacf7c024301591 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127455.699409:0:15453:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff8df7aeab6200/0xeeacf7c024301591 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127455.699432:0:15453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6826a4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:15453:1876035752786304:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789127455.699493:0:15453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127455.699550:0:15453:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df784d469c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789127455.699713:0:14761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752786304 00000100:00100000:1.0:1789127455.699719:0:14761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752786304 00000100:00100000:1.0:1789127455.699765:0:14761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789127455.699775:0:14761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b5666850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:396611f1-c34a-4e5a-8396-03624226b0e0+14:15453:x1876035752786304:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789127455.699809:0:14761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127455.699821:0:14761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df7bbd96400/0xeeacf7c024301598 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xeeacf7c024301591 expref: -99 pid: 14761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127455.699843:0:14761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df7bbd96400/0xeeacf7c024301598 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xeeacf7c024301591 expref: 15 pid: 14761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127455.699852:0:14761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df7bbd96400/0xeeacf7c024301598 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c024301591 expref: 15 pid: 14761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127455.699860:0:14761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7bbd96400, rc 0) 00000100:00100000:1.0:1789127455.699899:0:14761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b5666850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:396611f1-c34a-4e5a-8396-03624226b0e0+15:15453:x1876035752786304:12345-0@lo:101:mount.lustre.0 Request processed in 125us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127455.699906:0:14761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789127455.700024:0:15453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6826a4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:15453:1876035752786304:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789127455.700038:0:15453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff8df7aeab6200/0xeeacf7c024301591 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c024301598 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127455.700047:0:15453:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff8df7aeab6200/0xeeacf7c024301591 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xeeacf7c024301598 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789127455.700655:0:15453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1789127455.701729:0:15453:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789127455.702098:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1789127455.702152:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1789127455.702216:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1789127455.705398:0:15453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1789127455.705506:0:15453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6826a4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:15453:1876035752786432:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789127455.705815:0:15453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127455.705857:0:15453:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df784d469c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789127455.705945:0:14764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752786432 00000100:00100000:1.0:1789127455.705951:0:14764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752786432 00000100:00100000:1.0:1789127455.705986:0:14764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789127455.706001:0:14764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b5665c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:396611f1-c34a-4e5a-8396-03624226b0e0+15:15453:x1876035752786432:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789127455.706205:0:14764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b5665c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:396611f1-c34a-4e5a-8396-03624226b0e0+15:15453:x1876035752786432:12345-0@lo:501:mount.lustre.0 Request processed in 204us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127455.706213:0:14764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789127455.709683:0:15453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6826a4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:15453:1876035752786432:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789127455.709743:0:15453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae0403c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:15453:1876035752786560:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789127455.709836:0:15453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127455.709868:0:15453:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df790c8a900 going to sleep for 11 seconds 00000100:00100000:2.0:1789127455.709972:0:14763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752786560 00000100:00100000:2.0:1789127455.709979:0:14763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752786560 00000100:00100000:2.0:1789127455.710028:0:14763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789127455.710038:0:14763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b5666450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:396611f1-c34a-4e5a-8396-03624226b0e0+15:15453:x1876035752786560:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789127455.710214:0:14763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b5666450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:396611f1-c34a-4e5a-8396-03624226b0e0+15:15453:x1876035752786560:12345-0@lo:503:mount.lustre.0 Request processed in 177us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127455.710222:0:14763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789127455.710402:0:15453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae0403c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:15453:1876035752786560:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789127455.710960:0:15453:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789127455.711034:0:15453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae0403c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:15453:1876035752786688:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789127455.711081:0:15453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127455.711111:0:15453:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df790c8a900 going to sleep for 11 seconds 00000100:00100000:2.0:1789127455.711283:0:14761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752786688 00000100:00100000:2.0:1789127455.711288:0:14761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752786688 00000100:00100000:2.0:1789127455.711322:0:14761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789127455.711329:0:14761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b5664c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:396611f1-c34a-4e5a-8396-03624226b0e0+15:15453:x1876035752786688:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789127455.711490:0:14761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b5664c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:396611f1-c34a-4e5a-8396-03624226b0e0+15:15453:x1876035752786688:12345-0@lo:502:mount.lustre.0 Request processed in 161us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127455.711497:0:14761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789127455.712118:0:15453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae0403c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:15453:1876035752786688:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789127455.712434:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1789127455.712490:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1789127455.712995:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1789127455.713043:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1789127455.713077:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1789127455.713139:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1789127455.713181:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1789127455.713215:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 144 off9680 00000040:00080000:3.0:1789127455.714197:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9904 00000040:00080000:3.0:1789127455.714634:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10128 00000040:00080000:3.0:1789127455.714691:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10256 00000100:00100000:3.0:1789127455.714737:0:15453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae0403c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:15453:1876035752786816:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789127455.715359:0:15453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127455.715401:0:15453:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df790c8a900 going to sleep for 11 seconds 00000100:00100000:2.0:1789127455.715494:0:14761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752786816 00000100:00100000:2.0:1789127455.715501:0:14761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752786816 00000100:00100000:2.0:1789127455.715619:0:14761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789127455.715629:0:14761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b5667c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:396611f1-c34a-4e5a-8396-03624226b0e0+15:15453:x1876035752786816:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789127455.715937:0:14761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b5667c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:396611f1-c34a-4e5a-8396-03624226b0e0+15:15453:x1876035752786816:12345-0@lo:502:mount.lustre.0 Request processed in 308us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127455.715945:0:14761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789127455.716040:0:15453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae0403c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:15453:1876035752786816:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789127455.716122:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10480 00000040:00080000:3.0:1789127455.716134:0:15453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1789127455.718769:0:15472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789127455.718817:0:15472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127455.718820:0:15472:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789127455.718828:0:15472:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8df682b8a000 00000020:00000080:1.0:1789127455.718830:0:15472:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789127455.718837:0:15472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789127455.718839:0:15472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127455.718840:0:15472:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789127455.718843:0:15472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789127455.718845:0:15472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127455.718846:0:15472:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789127455.718849:0:15472:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8df682b8a000 00000020:00000080:1.0:1789127455.718850:0:15472:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789127455.718899:0:15472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789127455.718902:0:15472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127455.718904:0:15472:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789127455.718906:0:15472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789127455.718908:0:15472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127455.718909:0:15472:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:1.0:1789127455.718912:0:15472:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8df682b8a000 00000020:00000080:1.0:1789127455.718914:0:15472:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789127455.718929:0:15472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789127455.718931:0:15472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127455.718933:0:15472:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:1.0:1789127455.718935:0:15472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789127455.718937:0:15472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127455.718938:0:15472:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789127455.718941:0:15472:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8df682b8a000 00000020:00000080:1.0:1789127455.718952:0:15472:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789127455.718989:0:15472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789127455.718992:0:15472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127455.718994:0:15472:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1789127455.718996:0:15472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:3.0:1789127455.719113:0:15453:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1789127455.719142:0:15453:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789127455.719169:0:15453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df7aeab6200/0xeeacf7c024301591 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c024301598 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.719180:0:15453:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff8df7aeab6200/0xeeacf7c024301591 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c024301598 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127455.719222:0:15453:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789127455.719235:0:15453:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8df682b8a000 10000000:01000000:3.0:1789127455.719244:0:15453:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8df682b8a000 10000000:01000000:3.0:1789127455.719249:0:15453:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789127455.719265:0:15453:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8df682b8a000 from 1 10000000:01000000:3.0:1789127455.719267:0:15453:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789127455.719302:0:15453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df7c2051000/0xeeacf7c02430159f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.719310:0:15453:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff8df7c2051000/0xeeacf7c02430159f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.719320:0:15453:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff8df7c2051000/0xeeacf7c02430159f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127455.719344:0:15453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae0403c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:15453:1876035752786944:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789127455.719410:0:15453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127455.719449:0:15453:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df790c8ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1789127455.720349:0:14764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752786944 00000100:00100000:1.0:1789127455.720356:0:14764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752786944 00000100:00100000:1.0:1789127455.720405:0:14764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789127455.720414:0:14764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b5666050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:396611f1-c34a-4e5a-8396-03624226b0e0+15:15453:x1876035752786944:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789127455.720427:0:14764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127455.720441:0:14764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df7bbd97c00/0xeeacf7c0243015a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xeeacf7c02430159f expref: -99 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127455.720466:0:14764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df7bbd97c00/0xeeacf7c0243015a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xeeacf7c02430159f expref: 16 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127455.720478:0:14764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df7bbd97c00/0xeeacf7c0243015a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c02430159f expref: 16 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127455.720487:0:14764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7bbd97c00, rc 0) 00000100:00100000:1.0:1789127455.720548:0:14764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b5666050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:396611f1-c34a-4e5a-8396-03624226b0e0+16:15453:x1876035752786944:12345-0@lo:101:mount.lustre.0 Request processed in 135us (1137us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127455.720556:0:14764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789127455.720711:0:15453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae0403c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:15453:1876035752786944:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789127455.720727:0:15453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff8df7c2051000/0xeeacf7c02430159f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c0243015a6 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.720738:0:15453:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff8df7c2051000/0xeeacf7c02430159f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xeeacf7c0243015a6 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789127455.721963:0:15453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1789127455.722856:0:15453:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789127455.723158:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1789127455.723207:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1789127455.723271:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1789127455.723322:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1789127455.723359:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1789127455.723422:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1789127455.723458:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1789127455.723492:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1789127455.723669:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1789127455.723710:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1789127455.723743:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1789127455.723817:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1789127455.723856:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1789127455.723889:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1789127455.723932:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1789127455.723983:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1789127455.724018:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1789127455.724067:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1789127455.724101:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1789127455.724136:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1789127455.724179:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1789127455.724213:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1789127455.724244:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1789127455.724306:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1789127455.724343:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1789127455.724377:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1789127455.724440:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1789127455.724481:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1789127455.724904:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1789127455.724913:0:15453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1789127455.725029:0:15453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae0403c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:15453:1876035752787072:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789127455.725091:0:15453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127455.725183:0:15453:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df790c8ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1789127455.731569:0:14761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752787072 00000100:00100000:2.0:1789127455.731583:0:14761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752787072 00000100:00100000:2.0:1789127455.731644:0:14764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789127455.731654:0:14764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b5667450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:396611f1-c34a-4e5a-8396-03624226b0e0+16:15453:x1876035752787072:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789127455.737958:0:14764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b5667450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:396611f1-c34a-4e5a-8396-03624226b0e0+16:15453:x1876035752787072:12345-0@lo:501:mount.lustre.0 Request processed in 6296us (12857us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127455.737973:0:14764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789127455.738645:0:15453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae0403c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:15453:1876035752787072:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789127455.738704:0:15453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae0403c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:15453:1876035752787200:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789127455.738774:0:15453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127455.738840:0:15453:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df782d71840 going to sleep for 11 seconds 00000100:00100000:2.0:1789127455.738911:0:14763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752787200 00000100:00100000:2.0:1789127455.738918:0:14763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752787200 00000100:00100000:2.0:1789127455.738963:0:14763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789127455.738972:0:14763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b5664450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:396611f1-c34a-4e5a-8396-03624226b0e0+16:15453:x1876035752787200:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789127455.739143:0:14763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b5664450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:396611f1-c34a-4e5a-8396-03624226b0e0+16:15453:x1876035752787200:12345-0@lo:503:mount.lustre.0 Request processed in 171us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127455.739150:0:14763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789127455.739366:0:15453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae0403c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:15453:1876035752787200:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789127455.739884:0:15453:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789127455.739957:0:15453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae0403c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:15453:1876035752787328:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789127455.740001:0:15453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127455.746985:0:15453:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df790c8ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1789127455.750350:0:14761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752787328 00000100:00100000:0.0:1789127455.750364:0:14761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752787328 00000100:00100000:0.0:1789127455.750434:0:14763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789127455.750443:0:14763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b5667850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:396611f1-c34a-4e5a-8396-03624226b0e0+16:15453:x1876035752787328:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789127455.751650:0:14763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b5667850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:396611f1-c34a-4e5a-8396-03624226b0e0+16:15453:x1876035752787328:12345-0@lo:502:mount.lustre.0 Request processed in 1203us (11644us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127455.751662:0:14763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789127455.752393:0:15453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae0403c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:15453:1876035752787328:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789127455.752777:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1789127455.752859:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1789127455.752893:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1789127455.752940:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1789127455.752980:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1789127455.753040:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1789127455.753082:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1789127455.753118:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1789127455.753165:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1789127455.753204:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1789127455.755399:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1789127455.755510:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1789127455.755624:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1789127455.755661:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1789127455.755734:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1789127455.755785:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1789127455.755843:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1789127455.755894:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1789127455.755932:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1789127455.755967:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1789127455.756017:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1789127455.756055:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1789127455.756090:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1789127455.756140:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1789127455.756174:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1789127455.756204:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1789127455.759412:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1789127455.759488:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1789127455.759518:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1789127455.759561:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1789127455.759617:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1789127455.759648:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1789127455.759676:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1789127455.759718:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1789127455.759755:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1789127455.759833:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1789127455.759870:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1789127455.759898:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1789127455.759937:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1789127455.759970:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1789127455.760014:0:15453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6820be1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:15453:1876035752787456:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789127455.760080:0:15453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127455.760124:0:14763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752787456 00000100:00100000:0.0:1789127455.760130:0:14763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752787456 00000100:00100000:0.0:1789127455.760171:0:14763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789127455.760179:0:14763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b5664850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:396611f1-c34a-4e5a-8396-03624226b0e0+16:15453:x1876035752787456:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789127455.761441:0:14763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b5664850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:396611f1-c34a-4e5a-8396-03624226b0e0+16:15453:x1876035752787456:12345-0@lo:502:mount.lustre.0 Request processed in 1257us (1355us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127455.761453:0:14763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789127455.761506:0:15453:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7aea33cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789127455.761526:0:15453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6820be1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:15453:1876035752787456:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789127455.761619:0:15453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1789127455.761632:0:15453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1789127455.774662:0:15477:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1789127455.774679:0:15477:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8df7af70ced8) 00000020:00000080:0.0:1789127455.774701:0:15477:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1789127455.774825:0:15477:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8df682b8a000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789127455.774829:0:15477:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8df682b8a000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789127455.774832:0:15477:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8df682b8a000 3 00010000:00080000:0.0:1789127455.774869:0:15477:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8df78601f000@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.140@tcp at head 00010000:00010000:0.0:1789127455.777151:0:15477:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:0.0:1789127455.779450:0:15477:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1789127455.779489:0:15477:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789127455.779501:0:15477:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xeeacf7c0243015b4 00000100:00080000:0.0:1789127455.779511:0:15477:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789127455.779516:0:15477:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8df78601f000 using connection 192.168.206.140@tcp/0@lo 00000100:00100000:0.0:1789127455.779549:0:15477:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df6820be1c0 x1876035752787584/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789127455.779595:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6820be1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3299:1876035752787584:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789127455.779659:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127455.779721:0:14769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752787584 00000100:00100000:0.0:1789127455.779727:0:14769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752787584 00000100:00100000:0.0:1789127455.779754:0:14769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789127455.779768:0:14769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6820bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3299:x1876035752787584:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1789127455.779806:0:14769:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 401 last 0 00000020:00000080:0.0:1789127455.779846:0:14769:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xeeacf7c0243015bb 00000004:00100000:0.0:1789127455.779860:0:14769:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789127455.779894:0:14769:0:(import.c:65:import_set_state_nolock()) ffff8df79028c000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789127455.779945:0:14769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6820bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876035752787584:12345-0@lo:38:llog_process_th.0 Request processed in 176us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127455.779952:0:14769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789127455.779988:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8df6820be1c0 x1876035752787584/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789127465 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127455.779997:0:3299:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789127455.780004:0:3299:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1789127455.780010:0:3299:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789127455.780013:0:3299:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789127455.780016:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8df78601f000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789127455.780021:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6820be1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3299:1876035752787584:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1789127455.784409:0:15477:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789127455.784701:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789127455.784706:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789127455.784709:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789127455.784712:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789127455.784836:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae042940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876035752787712:0@lo:400:kworker.0 00000100:00100000:0.0:1789127455.784899:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:0.0:1789127455.785068:0:15477:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00100000:3.0:1789127455.785303:0:14771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752787712 00000100:00100000:3.0:1789127455.785310:0:14771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752787712 00000100:00100000:3.0:1789127455.785359:0:14771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789127455.785369:0:14771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6820be1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876035752787712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127455.785425:0:14771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6820be1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876035752787712:12345-0@lo:400:kworker.0 Request processed in 57us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127455.785433:0:14771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000020:01000000:3.0:1789127455.785455:0:15453:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1789127455.785483:0:15453:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789127455.785502:0:15453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df7c2051000/0xeeacf7c02430159f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c0243015a6 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.785513:0:15453:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff8df7c2051000/0xeeacf7c02430159f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c0243015a6 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789127455.785567:0:15453:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789127455.785569:0:15453:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789127455.785571:0:15453:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789127455.785572:0:15453:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789127455.785573:0:15453:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789127455.785575:0:15453:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789127455.785576:0:15453:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789127455.785578:0:15453:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789127455.785579:0:15453:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789127455.785583:0:15453:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1789127455.785585:0:15453:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789127455.785586:0:15453:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789127455.785588:0:15453:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789127455.785588:0:15453:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789127455.785589:0:15453:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789127455.785590:0:15453:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789127455.785591:0:15453:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789127455.785592:0:15453:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789127455.785593:0:15453:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789127455.785608:0:15453:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1789127455.785620:0:15453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae043c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:15453:1876035752787840:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789127455.785653:0:15453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127455.785677:0:15453:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df782d71000 going to sleep for 11 seconds 00000100:00100000:3.0:1789127455.785693:0:14764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752787840 00000100:00100000:3.0:1789127455.785696:0:14764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752787840 00000100:00100000:3.0:1789127455.785719:0:14764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789127455.785725:0:14764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b5667050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:396611f1-c34a-4e5a-8396-03624226b0e0+16:15453:x1876035752787840:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789127455.785755:0:14764:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789127455.785769:0:14764:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:0.0:1789127455.787515:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8df7ae042940 x1876035752787712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127471 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127455.787530:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae042940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876035752787712:0@lo:400:kworker.0 20000000:01000000:3.0:1789127455.824366:0:14764:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789127455.824385:0:14764:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1789127455.825033:0:14785:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789127455.825038:0:14785:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789127455.825058:0:14785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8df7aeab6000/0xeeacf7c0243015c2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127455.825074:0:14785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df7c2051200/0xeeacf7c02430152f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c024301528 expref: 16 pid: 14763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127455.825082:0:14785:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8df7aeab6000/0xeeacf7c0243015c2 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127455.825118:0:14785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df7c2051200/0xeeacf7c02430152f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xeeacf7c024301528 expref: 16 pid: 14763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127455.825132:0:14785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df7c2051200/0xeeacf7c02430152f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xeeacf7c024301528 expref: 16 pid: 14763 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127455.825158:0:14785:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6826a5a40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14785:1876035752787968:0@lo:104: 00000100:00100000:2.0:1789127455.825221:0:14785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127455.825397:0:14785:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df784d46f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789127455.833839:0:14752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752787968 00000100:00100000:3.0:1789127455.833852:0:14752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752787968 00000100:00100000:3.0:1789127455.833929:0:14753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789127455.833940:0:14753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6826a5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:396611f1-c34a-4e5a-8396-03624226b0e0+3:14785:x1876035752787968:12345-0@lo:104: 00010000:00010000:3.0:1789127455.833959:0:14753:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.140@tcp lock: ffff8df7ae728600/0xeeacf7c024301528 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xeeacf7c02430152f expref: -99 pid: 14767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.834046:0:14753:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789127455.834052:0:14753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6826a5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:396611f1-c34a-4e5a-8396-03624226b0e0+3:14785:x1876035752787968:12345-0@lo:104: Request processed in 114us (8832us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127455.834060:0:14753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789127455.834104:0:14785:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6826a5a40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14785:1876035752787968:0@lo:104: 00010000:00010000:3.0:1789127455.834128:0:14785:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8df7aeab6000/0xeeacf7c0243015c2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.834145:0:14757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789127455.834151:0:14757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.140@tcp lock: ffff8df7ae728600/0xeeacf7c024301528 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xeeacf7c02430152f expref: -99 pid: 14767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.834157:0:14757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7ae728600 already unused, calling callback (ffffffffc1da1c20) 10000000:00010000:3.0:1789127455.834161:0:14757:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.140@tcp lock: ffff8df7ae728600/0xeeacf7c024301528 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xeeacf7c02430152f expref: -99 pid: 14767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.834168:0:14757:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: ffff8df7ae728600/0xeeacf7c024301528 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xeeacf7c02430152f expref: -99 pid: 14767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789127455.834175:0:14757:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: ffff8df7ae728600/0xeeacf7c024301528 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xeeacf7c02430152f expref: -99 pid: 14767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127455.834180:0:14757:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789127455.834211:0:14757:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.140@tcp lock: ffff8df7ae728600/0xeeacf7c024301528 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c02430152f expref: -99 pid: 14767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.834224:0:14757:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789127455.834245:0:14757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.140@tcp lock: ffff8df7ae728600/0xeeacf7c024301528 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c02430152f expref: -99 pid: 14767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.834261:0:14757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: ffff8df7ae728600/0xeeacf7c024301528 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c02430152f expref: -99 pid: 14767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.834279:0:14757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127455.834281:0:14757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127455.834283:0:14757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127455.834303:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae040f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:396611f1-c34a-4e5a-8396-03624226b0e0:3301:1876035752788096:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789127455.834339:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127455.834391:0:14756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752788096 00000100:00100000:3.0:1789127455.834395:0:14756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752788096 00010000:00010000:3.0:1789127455.834411:0:14756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df7c2051200/0xeeacf7c02430152f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xeeacf7c024301528 expref: 17 pid: 14763 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127455.834432:0:14756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789127455.834438:0:14756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae040000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:396611f1-c34a-4e5a-8396-03624226b0e0+17:3301:x1876035752788096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789127455.834450:0:14756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127455.834454:0:14756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df7c2051200/0xeeacf7c02430152f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xeeacf7c024301528 expref: 17 pid: 14763 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.834465:0:14756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df7c2051200/0xeeacf7c02430152f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xeeacf7c024301528 expref: 17 pid: 14763 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.834478:0:14756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df7c2051200/0xeeacf7c02430152f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xeeacf7c024301528 expref: 17 pid: 14763 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.834501:0:14756:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8df7aeab6000/0xeeacf7c0243015c2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.834509:0:14756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df7aeab6000/0xeeacf7c0243015c2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789127455.834522:0:14756:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009484180s 00010000:00010000:3.0:1789127455.834526:0:14756:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df7aeab6000/0xeeacf7c0243015c2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.834532:0:14756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df7aeab6000/0xeeacf7c0243015c2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.834539:0:14756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8df7aeab6000/0xeeacf7c0243015c2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.834545:0:14756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8df7aeab6000/0xeeacf7c0243015c2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.834550:0:14756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7aeab6000 already unused, calling callback (ffffffffc17a4550) 00010000:00010000:3.0:1789127455.834554:0:14756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8df7aeab6000/0xeeacf7c0243015c2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.834562:0:14756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8df7aeab6000/0xeeacf7c0243015c2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.834575:0:14756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8df7aeab6000/0xeeacf7c0243015c2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.834584:0:14756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127455.834615:0:14756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae040000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:396611f1-c34a-4e5a-8396-03624226b0e0+16:3301:x1876035752788096:12345-0@lo:103:ldlm_bl.0 Request processed in 178us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127455.834623:0:14756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1789127455.834643:0:14785:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8df7aeab6000/0xeeacf7c0243015c2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.834651:0:14785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8df7aeab6000/0xeeacf7c0243015c2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.834658:0:14785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df7aeab6000/0xeeacf7c0243015c2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127455.834682:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae040f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:396611f1-c34a-4e5a-8396-03624226b0e0:3301:1876035752788096:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789127455.844370:0:14764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b5667050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:396611f1-c34a-4e5a-8396-03624226b0e0+15:15453:x1876035752787840:12345-0@lo:253:mount.lustre.0 Request processed in 58636us (58707us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127455.844396:0:14764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789127455.844481:0:15453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae043c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:15453:1876035752787840:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789127455.844496:0:15453:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1789127455.844499:0:15453:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789127455.844501:0:15453:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789127455.844502:0:15453:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789127455.844503:0:15453:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789127455.844505:0:15453:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789127455.844506:0:15453:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789127455.844507:0:15453:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789127455.844509:0:15453:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789127455.844510:0:15453:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789127455.844523:0:15453:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1789127455.852430:0:15453:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1789127455.852596:0:15453:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1789127455.852752:0:15453:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1789127455.852940:0:15453:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1789127455.853135:0:15453:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x8:0x0] (8/8/4) registered 00080000:10000000:0.0:1789127455.853481:0:15453:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1789127455.854378:0:15453:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1789127455.897076:0:15453:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1789127455.897085:0:15453:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1789127455.897122:0:15453:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789127455.897178:0:15453:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.140@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789127455.897192:0:15453:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1789127455.897218:0:15453:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1789127456.504731:0:14758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127457.527114:0:14757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789127457.778921:0:14767:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789127457.778927:0:14767:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8df7bfc78000 from 7 10000000:01000000:2.0:1789127457.778931:0:14767:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789127457.778980:0:14767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df7aeab7c00/0xeeacf7c0243015c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127457.778991:0:14767:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff8df7aeab7c00/0xeeacf7c0243015c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127457.779001:0:14767:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff8df7aeab7c00/0xeeacf7c0243015c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127457.779024:0:14767:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6826a61c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:396611f1-c34a-4e5a-8396-03624226b0e0:14767:1876035752788224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789127457.779086:0:14767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127457.779131:0:14767:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7833fab40 going to sleep for 11 seconds 00000100:00100000:3.0:1789127457.779185:0:14761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752788224 00000100:00100000:3.0:1789127457.779193:0:14761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752788224 00000100:00100000:3.0:1789127457.779263:0:14761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789127457.779273:0:14761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7af253450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:396611f1-c34a-4e5a-8396-03624226b0e0+15:14767:x1876035752788224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789127457.779285:0:14761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127457.779304:0:14761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df7c2051200/0xeeacf7c0243015d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xeeacf7c0243015c9 expref: -99 pid: 14761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127457.779326:0:14761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df7c2051200/0xeeacf7c0243015d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xeeacf7c0243015c9 expref: 16 pid: 14761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127457.779335:0:14761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df7c2051200/0xeeacf7c0243015d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c0243015c9 expref: 16 pid: 14761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127457.779343:0:14761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7c2051200, rc 0) 00000100:00100000:3.0:1789127457.779386:0:14761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7af253450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:396611f1-c34a-4e5a-8396-03624226b0e0+16:14767:x1876035752788224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127457.779392:0:14761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789127457.779437:0:14767:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6826a61c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:396611f1-c34a-4e5a-8396-03624226b0e0:14767:1876035752788224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789127457.779451:0:14767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff8df7aeab7c00/0xeeacf7c0243015c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c0243015d0 expref: -99 pid: 14767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127457.779460:0:14767:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff8df7aeab7c00/0xeeacf7c0243015c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xeeacf7c0243015d0 expref: -99 pid: 14767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127457.779510:0:14767:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae043c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:396611f1-c34a-4e5a-8396-03624226b0e0:14767:1876035752788352:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789127457.779539:0:14767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127457.779555:0:14767:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7a1fcd240 going to sleep for 11 seconds 00000100:00100000:3.0:1789127457.779568:0:14764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752788352 00000100:00100000:3.0:1789127457.779572:0:14764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752788352 00000100:00100000:3.0:1789127457.779593:0:14764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789127457.779599:0:14764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7af250450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:396611f1-c34a-4e5a-8396-03624226b0e0+16:14767:x1876035752788352:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789127457.779720:0:14764:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789127457.779739:0:14764:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789127457.779742:0:14764:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1789127457.779851:0:14764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7af250450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:396611f1-c34a-4e5a-8396-03624226b0e0+16:14767:x1876035752788352:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 251us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127457.779859:0:14764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789127457.779972:0:14767:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae043c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:396611f1-c34a-4e5a-8396-03624226b0e0:14767:1876035752788352:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789127457.780030:0:14767:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789127457.780037:0:14767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df7aeab7c00/0xeeacf7c0243015c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c0243015d0 expref: -99 pid: 14767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127457.780045:0:14767:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff8df7aeab7c00/0xeeacf7c0243015c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c0243015d0 expref: -99 pid: 14767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127458.547342:0:14758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127459.570899:0:14757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127460.600692:0:14758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789127460.853578:0:14317:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789127460.853585:0:14317:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789127460.853588:0:14317:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789127460.853591:0:14317:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789127460.853650:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae040f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:396611f1-c34a-4e5a-8396-03624226b0e0:3302:1876035752788480:0@lo:400:kworker.0 00000100:00100000:3.0:1789127460.853737:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127460.853813:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789127460.853820:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae043c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876035752788608:0@lo:400:kworker.0 00000100:00100000:3.0:1789127460.853850:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127460.853888:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae042940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1876035752788736:0@lo:400:kworker.0 00000100:00100000:3.0:1789127460.853916:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127460.853951:0:14763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752788480 00000100:00100000:3.0:1789127460.853959:0:14763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752788480 00000100:00100000:3.0:1789127460.853999:0:14763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789127460.854008:0:14763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7af253850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:396611f1-c34a-4e5a-8396-03624226b0e0+16:3302:x1876035752788480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127460.854059:0:14763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7af253850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:396611f1-c34a-4e5a-8396-03624226b0e0+16:3302:x1876035752788480:12345-0@lo:400:kworker.0 Request processed in 50us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127460.854066:0:14763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789127460.854101:0:14770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752788608 00000100:00100000:3.0:1789127460.854105:0:14770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752788608 00000100:00100000:3.0:1789127460.854146:0:14770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752788736 00000100:00100000:3.0:1789127460.854149:0:14770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752788736 00000100:00100000:3.0:1789127460.854179:0:14770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789127460.854185:0:14770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae0403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876035752788608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127460.854218:0:14770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae0403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876035752788608:12345-0@lo:400:kworker.0 Request processed in 33us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127460.854236:0:14770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789127460.854250:0:14770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789127460.854256:0:14770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae041a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876035752788736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127460.854289:0:14770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae041a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876035752788736:12345-0@lo:400:kworker.0 Request processed in 34us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127460.854294:0:14770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789127460.854337:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df7ae042940 x1876035752788736/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127476 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127460.854350:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae042940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1876035752788736:0@lo:400:kworker.0 00010000:00080000:3.0:1789127460.854377:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df7ae043c00 x1876035752788608/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127476 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127460.854386:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae043c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876035752788608:0@lo:400:kworker.0 00000100:00100000:3.0:1789127460.854394:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae040f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:396611f1-c34a-4e5a-8396-03624226b0e0:3302:1876035752788480:0@lo:400:kworker.0 00000100:00080000:1.0:1789127460.857948:0:14765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789127461.620870:0:14757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789127462.086658:0:15822:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789127462.644491:0:14758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127463.668361:0:14757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789127464.126685:0:14801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789127464.691064:0:14758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127465.715213:0:14757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789127465.977409:0:14317:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:3.0:1789127465.977422:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6826a7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:396611f1-c34a-4e5a-8396-03624226b0e0:3301:1876035752788864:0@lo:400:kworker.0 00000100:00080000:2.0:1789127465.977425:0:14317:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789127465.977428:0:14317:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789127465.977430:0:14317:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789127465.977529:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127465.977571:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6826a4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876035752788992:0@lo:400:kworker.0 00000100:00100000:2.0:1789127465.977608:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127465.977630:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6826a6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1876035752789120:0@lo:400:kworker.0 00000100:00100000:1.0:1789127465.977666:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127465.977678:0:14770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752788992 00000100:00100000:2.0:1789127465.977684:0:14770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752788992 00000100:00100000:1.0:1789127465.977699:0:14771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752789120 00000100:00100000:1.0:1789127465.977702:0:14771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752789120 00000100:00100000:2.0:1789127465.977722:0:14770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789127465.977729:0:14770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6826a70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876035752788992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127465.977774:0:14769:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1789127465.977774:0:14770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6826a70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876035752788992:12345-0@lo:400:kworker.0 Request processed in 45us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127465.977781:0:14769:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1789127465.977822:0:14761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752788864 00000100:00100000:3.0:1789127465.977826:0:14761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752788864 00000100:00100000:3.0:1789127465.977851:0:14761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789127465.977857:0:14761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7af250850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:396611f1-c34a-4e5a-8396-03624226b0e0+16:3301:x1876035752788864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127465.977909:0:14761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7af250850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:396611f1-c34a-4e5a-8396-03624226b0e0+16:3301:x1876035752788864:12345-0@lo:400:kworker.0 Request processed in 51us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127465.977915:0:14761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789127465.978066:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6826a7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:396611f1-c34a-4e5a-8396-03624226b0e0:3301:1876035752788864:0@lo:400:kworker.0 00000100:00080000:0.0:1789127465.981625:0:14765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789127465.981693:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df6826a4f00 x1876035752788992/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127481 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127465.981709:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6826a4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876035752788992:0@lo:400:kworker.0 00000100:00100000:1.0:1789127465.981982:0:14771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789127465.981998:0:14771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae2fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876035752789120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127465.982086:0:14771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae2fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876035752789120:12345-0@lo:400:kworker.0 Request processed in 94us (4419us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127465.982094:0:14771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1789127465.982132:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df6826a6d00 x1876035752789120/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127481 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127465.982143:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6826a6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1876035752789120:0@lo:400:kworker.0 00000100:00100000:2.0:1789127465.982311:0:14770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1789127466.739109:0:14758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127467.064474:0:3299:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789127452/real 1789127452] req@ffff8df7ae0430c0 x1876035752784896/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789127467 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127467.064504:0:3299:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8df7ae0430c0 x1876035752784896/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789127467 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127467.064514:0:3299:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789127452/real 1789127452] req@ffff8df7ae043480 x1876035752785024/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789127467 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127467.064526:0:3299:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8df7ae043480 x1876035752785024/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789127467 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789127467.064544:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8df78803a800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789127467.064567:0:3299:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789127467.064571:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae0430c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1876035752784896:0@lo:8:kworker.0 00000100:00080000:2.0:1789127467.064588:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8df7bb5d1800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789127467.064594:0:3299:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789127467.064597:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae043480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1876035752785024:0@lo:8:kworker.0 00000100:00080000:3.0:1789127467.064699:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789127467.064704:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1789127467.064706:0:8:0:(import.c:65:import_set_state_nolock()) ffff8df78803a800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789127467.064710:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 398 00000100:00080000:3.0:1789127467.064715:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789127467.064720:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8df78803a800 using connection 192.168.206.140@tcp/0@lo 00000100:00100000:3.0:1789127467.064738:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df7ae042940 x1876035752789376/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789127467.064750:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789127467.064753:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789127467.064754:0:8:0:(import.c:65:import_set_state_nolock()) ffff8df7bb5d1800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789127467.064757:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 398 00000100:00080000:3.0:1789127467.064759:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789127467.064762:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8df7bb5d1800 using connection 192.168.206.140@tcp/0@lo 00000100:00100000:3.0:1789127467.064771:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df7ae042d00 x1876035752789504/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789127467.064845:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789127467.064864:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae040b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1876035752789760:0@lo:400:kworker.0 00000100:00100000:3.0:1789127467.064927:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127467.064982:0:14771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752789760 00000100:00100000:3.0:1789127467.064988:0:14771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752789760 00000100:00100000:3.0:1789127467.065033:0:14771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789127467.065042:0:14771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae0421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876035752789760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127467.065086:0:14771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae0421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876035752789760:12345-0@lo:400:kworker.0 Request processed in 45us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127467.065094:0:14771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1789127467.065184:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df7ae040b40 x1876035752789760/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127483 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127467.065205:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae040b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1876035752789760:0@lo:400:kworker.0 00000100:00100000:0.0:1789127467.065348:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae041680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876035752789632:0@lo:400:kworker.0 00000100:00100000:0.0:1789127467.065377:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127467.065411:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789127467.065416:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae043c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:396611f1-c34a-4e5a-8396-03624226b0e0:3301:1876035752789248:0@lo:400:kworker.0 00000100:00100000:0.0:1789127467.065451:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789127467.065480:0:14765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789127467.065491:0:15986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752789632 00000100:00100000:0.0:1789127467.065495:0:15986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752789632 00000100:00100000:0.0:1789127467.065517:0:15986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789127467.065524:0:15986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6820bc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876035752789632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127467.065559:0:15986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6820bc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876035752789632:12345-0@lo:400:kworker.0 Request processed in 35us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127467.065566:0:15986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1789127467.065589:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df7ae041680 x1876035752789632/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127483 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127467.065598:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae041680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876035752789632:0@lo:400:kworker.0 00000100:00100000:2.0:1789127467.065704:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae042940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1876035752789376:0@lo:8:kworker.0 00000100:00100000:2.0:1789127467.065737:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127467.065754:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae042d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1876035752789504:0@lo:8:kworker.0 00000100:00100000:2.0:1789127467.065812:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127467.065985:0:15455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752789376 00000100:00100000:0.0:1789127467.065989:0:15455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752789376 00000100:00100000:0.0:1789127467.066010:0:15455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752789504 00000100:00100000:0.0:1789127467.066013:0:15455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752789504 00000100:00100000:0.0:1789127467.066022:0:15455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789127467.066027:0:15455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6826a7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3299:x1876035752789376:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1789127467.066048:0:15455:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 413 last 0 00000020:00000080:0.0:1789127467.066072:0:15455:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xeeacf7c0243015d7 00002000:00100000:0.0:1789127467.066085:0:15455:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8df786000800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113987 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1789127467.066089:0:15455:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1789127467.066091:0:15455:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789127467.066487:0:15455:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789127467.066509:0:15455:0:(import.c:65:import_set_state_nolock()) ffff8df786004000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789127467.066552:0:15455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6826a7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3299:x1876035752789376:12345-0@lo:8:kworker.0 Request processed in 523us (813us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127467.066567:0:15455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789127467.066582:0:15455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789127467.066586:0:15455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6826a52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3299:x1876035752789504:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1789127467.066596:0:15455:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789127467.066620:0:15455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6826a52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3299:x1876035752789504:12345-0@lo:8:kworker.0 Request processed in 34us (808us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789127467.066626:0:15455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789127467.067303:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df7ae042940 x1876035752789376/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789127487 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127467.067313:0:3299:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789127467.067320:0:3299:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1789127467.067326:0:3299:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789127467.067331:0:3299:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1789127467.067333:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8df78803a800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789127467.067356:0:3299:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789127467.067360:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae042940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1876035752789376:0@lo:8:kworker.0 00000100:00080000:2.0:1789127467.067372:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8df7bb5d1800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789127467.067375:0:3299:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789127467.067378:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae042d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1876035752789504:0@lo:8:kworker.0 00000004:00080000:2.0:1789127467.067417:0:14791:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789127467.067650:0:14791:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 413223860083ns, next at 0ns, rc = 0 00000100:00100000:3.0:1789127467.068295:0:14764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752789248 00000100:00100000:3.0:1789127467.068302:0:14764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752789248 00000100:00100000:3.0:1789127467.068349:0:14764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789127467.068356:0:14764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7af253050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:396611f1-c34a-4e5a-8396-03624226b0e0+16:3301:x1876035752789248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127467.068440:0:14764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7af253050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:396611f1-c34a-4e5a-8396-03624226b0e0+16:3301:x1876035752789248:12345-0@lo:400:kworker.0 Request processed in 84us (2987us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127467.068448:0:14764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789127467.068503:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae043c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:396611f1-c34a-4e5a-8396-03624226b0e0:3301:1876035752789248:0@lo:400:kworker.0 00000004:00080000:0.0:1789127467.070590:0:14792:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:0.0:1789127467.070658:0:14792:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6820bde00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14792:1876035752790016:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1789127467.070715:0:14792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127467.070745:0:14792:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7aea31240 going to sleep for 11 seconds 00000100:00100000:3.0:1789127467.071354:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6820be940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1876035752789888:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789127467.071422:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127467.073591:0:15458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752789888 00000100:00100000:2.0:1789127467.073602:0:15458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752789888 00000100:00100000:2.0:1789127467.073661:0:15458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789127467.073670:0:15458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae043c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1876035752789888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789127467.073711:0:15458:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789127467.073807:0:15458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae043c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1876035752789888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (2364us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127467.073815:0:15458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789127467.073871:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df6820be940 x1876035752789888/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127483 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127467.073891:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6820be940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1876035752789888:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789127467.074369:0:14765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789127467.074819:0:15455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752790016 00000100:00100000:0.0:1789127467.074827:0:15455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752790016 00000100:00100000:0.0:1789127467.074865:0:15455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789127467.074896:0:15455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6820bfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14792:x1876035752790016:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1789127467.088085:0:15455:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1789127467.088095:0:15455:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1789127467.088100:0:15455:0:(ofd_dev.c:1505:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00002000:00010000:1.0:1789127467.127748:0:15455:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789127467.127764:0:15455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df3a4803/0xeeacf7c0243015de lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127467.127783:0:15455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=413s v=(0 0) 00010000:00010000:1.0:1789127467.127807:0:15455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789127467.127814:0:15455:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df3a4803/0xeeacf7c0243015de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127467.127833:0:15455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df3a4803/0xeeacf7c0243015de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127467.127844:0:15455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df3a4803/0xeeacf7c0243015de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127467.127867:0:15455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df3a4803/0xeeacf7c0243015de lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127467.127886:0:15455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789127467.127899:0:14757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789127467.127905:0:14757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df3a4803/0xeeacf7c0243015de lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127467.127913:0:14757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd97a00 already unused, calling callback (ffffffffc17a4550) 00010000:00010000:1.0:1789127467.127918:0:14757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df3a4803/0xeeacf7c0243015de lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127467.127927:0:14757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df3a4803/0xeeacf7c0243015de lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127467.127945:0:14757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df3a4803/0xeeacf7c0243015de lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127467.127953:0:14757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df3a4803/0xeeacf7c0243015de lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127467.127970:0:14757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127467.127972:0:14757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127467.127973:0:14757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789127467.128784:0:15455:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00000004:00080000:2.0:1789127467.129044:0:5852:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:1.0:1789127467.129380:0:15455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039d1d77c/0xeeacf7c0243015e5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127467.129392:0:15455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=413s v=(0 0) 00010000:00010000:1.0:1789127467.129396:0:15455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789127467.130066:0:15455:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000039d1d77c/0xeeacf7c0243015e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127467.130080:0:15455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000039d1d77c/0xeeacf7c0243015e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127467.130091:0:15455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039d1d77c/0xeeacf7c0243015e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127467.130098:0:15455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000039d1d77c/0xeeacf7c0243015e5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127467.131736:0:15455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789127467.136067:0:14758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789127467.136081:0:14758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000039d1d77c/0xeeacf7c0243015e5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127467.136107:0:14758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd96600 already unused, calling callback (ffffffffc17a4550) 00010000:00010000:3.0:1789127467.136112:0:14758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000039d1d77c/0xeeacf7c0243015e5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127467.136124:0:14758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000039d1d77c/0xeeacf7c0243015e5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127467.136158:0:14758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000039d1d77c/0xeeacf7c0243015e5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127467.136177:0:14758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000039d1d77c/0xeeacf7c0243015e5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127467.136319:0:14758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127467.136321:0:14758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127467.136323:0:14758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789127467.138052:0:15455:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789127467.138062:0:15455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e558dd3e/0xeeacf7c0243015ec lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127467.138076:0:15455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=413s v=(0 0) 00010000:00010000:1.0:1789127467.138081:0:15455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789127467.138087:0:15455:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e558dd3e/0xeeacf7c0243015ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127467.138100:0:15455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e558dd3e/0xeeacf7c0243015ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127467.138116:0:15455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e558dd3e/0xeeacf7c0243015ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127467.138124:0:15455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e558dd3e/0xeeacf7c0243015ec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127467.138159:0:15455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789127467.138365:0:14757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789127467.138372:0:14757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e558dd3e/0xeeacf7c0243015ec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127467.138381:0:14757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd96c00 already unused, calling callback (ffffffffc17a4550) 00010000:00010000:3.0:1789127467.138384:0:14757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e558dd3e/0xeeacf7c0243015ec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127467.138393:0:14757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e558dd3e/0xeeacf7c0243015ec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127467.138421:0:14757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e558dd3e/0xeeacf7c0243015ec lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127467.138448:0:14757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127467.138449:0:14757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127467.138451:0:14757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127467.138518:0:15455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e558dd3e/0xeeacf7c0243015ec lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789127467.139315:0:15455:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789127467.139322:0:15455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df3a4803/0xeeacf7c0243015f3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127467.139332:0:15455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=413s v=(0 0) 00010000:00010000:1.0:1789127467.139335:0:15455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789127467.139341:0:15455:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df3a4803/0xeeacf7c0243015f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127467.139350:0:15455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df3a4803/0xeeacf7c0243015f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127467.139357:0:15455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df3a4803/0xeeacf7c0243015f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127467.139375:0:15455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df3a4803/0xeeacf7c0243015f3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127467.139399:0:15455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789127467.139568:0:14758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789127467.139575:0:14758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df3a4803/0xeeacf7c0243015f3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127467.139583:0:14758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd97a00 already unused, calling callback (ffffffffc17a4550) 00010000:00010000:3.0:1789127467.139586:0:14758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df3a4803/0xeeacf7c0243015f3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127467.139594:0:14758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df3a4803/0xeeacf7c0243015f3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127467.139606:0:14758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df3a4803/0xeeacf7c0243015f3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127467.139613:0:14758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df3a4803/0xeeacf7c0243015f3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127467.139626:0:14758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127467.139628:0:14758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127467.139630:0:14758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789127467.140077:0:15455:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789127467.140084:0:15455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003385800f/0xeeacf7c0243015fa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127467.140093:0:15455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=413s v=(0 0) 00010000:00010000:1.0:1789127467.140096:0:15455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789127467.140100:0:15455:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003385800f/0xeeacf7c0243015fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127467.140109:0:15455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003385800f/0xeeacf7c0243015fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127467.140117:0:15455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003385800f/0xeeacf7c0243015fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127467.140124:0:15455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003385800f/0xeeacf7c0243015fa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127467.140389:0:15455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789127467.149651:0:15455:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789127467.149666:0:15455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a9d083a/0xeeacf7c024301601 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127467.149690:0:15455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=413s v=(0 0) 00010000:00010000:1.0:1789127467.149695:0:15455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789127467.149702:0:15455:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a9d083a/0xeeacf7c024301601 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127467.149718:0:15455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a9d083a/0xeeacf7c024301601 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127467.149729:0:15455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a9d083a/0xeeacf7c024301601 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127467.149737:0:15455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a9d083a/0xeeacf7c024301601 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127467.152274:0:14757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789127467.152287:0:14757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003385800f/0xeeacf7c0243015fa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127467.152311:0:14757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd97200 already unused, calling callback (ffffffffc17a4550) 00010000:00010000:3.0:1789127467.152316:0:14757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003385800f/0xeeacf7c0243015fa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127467.152327:0:14757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003385800f/0xeeacf7c0243015fa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127467.152347:0:14757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003385800f/0xeeacf7c0243015fa lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127467.152354:0:14757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003385800f/0xeeacf7c0243015fa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127467.152374:0:14757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789127467.152378:0:14757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a9d083a/0xeeacf7c024301601 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127467.152384:0:14757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd97800 already unused, calling callback (ffffffffc17a4550) 00010000:00010000:3.0:1789127467.152387:0:14757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a9d083a/0xeeacf7c024301601 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127467.152394:0:14757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a9d083a/0xeeacf7c024301601 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127467.152415:0:14757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a9d083a/0xeeacf7c024301601 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127467.152427:0:14757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127467.152429:0:14757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127467.152431:0:14757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127467.154641:0:15455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789127467.154654:0:15455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a9d083a/0xeeacf7c024301601 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789127467.155364:0:15455:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789127467.155371:0:15455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e724354/0xeeacf7c024301608 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127467.155384:0:15455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=413s v=(0 0) 00010000:00010000:0.0:1789127467.155388:0:15455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789127467.155394:0:15455:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e724354/0xeeacf7c024301608 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127467.155550:0:15455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e724354/0xeeacf7c024301608 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127467.155561:0:15455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e724354/0xeeacf7c024301608 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127467.155567:0:15455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006e724354/0xeeacf7c024301608 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127467.161896:0:14758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789127467.161909:0:14758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006e724354/0xeeacf7c024301608 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127467.161924:0:14758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7ae728000 already unused, calling callback (ffffffffc17a4550) 00010000:00010000:3.0:1789127467.161929:0:14758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006e724354/0xeeacf7c024301608 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127467.161941:0:14758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006e724354/0xeeacf7c024301608 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127467.161961:0:14758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006e724354/0xeeacf7c024301608 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127467.161971:0:14758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127467.161973:0:14758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127467.161975:0:14758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127467.164969:0:15455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789127467.164983:0:15455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e724354/0xeeacf7c024301608 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789127467.165626:0:15455:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789127467.165635:0:15455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d049aa09/0xeeacf7c02430160f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127467.165649:0:15455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=413s v=(0 0) 00010000:00010000:0.0:1789127467.165654:0:15455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789127467.165660:0:15455:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d049aa09/0xeeacf7c02430160f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127467.165674:0:15455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d049aa09/0xeeacf7c02430160f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127467.165697:0:15455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d049aa09/0xeeacf7c02430160f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127467.165705:0:15455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d049aa09/0xeeacf7c02430160f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127467.171308:0:14757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789127467.171322:0:14757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d049aa09/0xeeacf7c02430160f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127467.171337:0:14757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7ae728600 already unused, calling callback (ffffffffc17a4550) 00010000:00010000:3.0:1789127467.171341:0:14757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d049aa09/0xeeacf7c02430160f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127467.171362:0:14757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d049aa09/0xeeacf7c02430160f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127467.171383:0:14757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d049aa09/0xeeacf7c02430160f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127467.171394:0:14757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127467.171468:0:14757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127467.171471:0:14757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127467.175294:0:14758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127467.175352:0:15455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789127467.175364:0:15455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d049aa09/0xeeacf7c02430160f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789127467.175999:0:15455:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789127467.176006:0:15455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000120833fb/0xeeacf7c024301616 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127467.176019:0:15455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=413s v=(0 0) 00010000:00010000:0.0:1789127467.176024:0:15455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789127467.176030:0:15455:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000120833fb/0xeeacf7c024301616 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127467.176043:0:15455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000120833fb/0xeeacf7c024301616 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127467.176052:0:15455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000120833fb/0xeeacf7c024301616 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127467.176069:0:15455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000120833fb/0xeeacf7c024301616 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127467.176088:0:15455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789127467.176419:0:14757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789127467.176427:0:14757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000120833fb/0xeeacf7c024301616 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127467.176435:0:14757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7ae729c00 already unused, calling callback (ffffffffc17a4550) 00010000:00010000:3.0:1789127467.176439:0:14757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000120833fb/0xeeacf7c024301616 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127467.176448:0:14757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000120833fb/0xeeacf7c024301616 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127467.176466:0:14757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000120833fb/0xeeacf7c024301616 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127467.176474:0:14757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000120833fb/0xeeacf7c024301616 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127467.176504:0:14757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127467.176505:0:14757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127467.176507:0:14757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789127467.179026:0:15455:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789127467.179037:0:15455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034fe2966/0xeeacf7c02430161d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127467.179051:0:15455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=413s v=(0 0) 00010000:00010000:0.0:1789127467.179056:0:15455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789127467.179062:0:15455:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000034fe2966/0xeeacf7c02430161d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127467.179075:0:15455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000034fe2966/0xeeacf7c02430161d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127467.179085:0:15455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034fe2966/0xeeacf7c02430161d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127467.179092:0:15455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000034fe2966/0xeeacf7c02430161d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127467.179111:0:15455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789127467.180306:0:14758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789127467.180317:0:14758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000034fe2966/0xeeacf7c02430161d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127467.180328:0:14758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7ae729200 already unused, calling callback (ffffffffc17a4550) 00010000:00010000:3.0:1789127467.180334:0:14758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000034fe2966/0xeeacf7c02430161d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127467.180343:0:14758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000034fe2966/0xeeacf7c02430161d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127467.180361:0:14758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000034fe2966/0xeeacf7c02430161d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127467.180368:0:14758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000034fe2966/0xeeacf7c02430161d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127467.180392:0:14758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127467.180394:0:14758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127467.180396:0:14758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789127467.182086:0:15455:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789127467.182095:0:15455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a7963f3/0xeeacf7c024301624 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127467.182116:0:15455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=413s v=(0 0) 00010000:00010000:0.0:1789127467.182120:0:15455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789127467.182126:0:15455:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a7963f3/0xeeacf7c024301624 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127467.182152:0:15455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a7963f3/0xeeacf7c024301624 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127467.184289:0:15455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a7963f3/0xeeacf7c024301624 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127467.184306:0:15455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a7963f3/0xeeacf7c024301624 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127467.191359:0:15455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789127467.191497:0:14757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789127467.191506:0:14757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a7963f3/0xeeacf7c024301624 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127467.191529:0:14757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7ae729e00 already unused, calling callback (ffffffffc17a4550) 00010000:00010000:3.0:1789127467.191534:0:14757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a7963f3/0xeeacf7c024301624 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127467.191543:0:14757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a7963f3/0xeeacf7c024301624 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127467.191562:0:14757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a7963f3/0xeeacf7c024301624 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127467.191569:0:14757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a7963f3/0xeeacf7c024301624 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127467.191587:0:14757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127467.191589:0:14757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127467.191591:0:14757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789127467.193631:0:15455:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789127467.193643:0:15455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a9d083a/0xeeacf7c02430162b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127467.193658:0:15455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=413s v=(0 0) 00010000:00010000:1.0:1789127467.193662:0:15455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789127467.193667:0:15455:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a9d083a/0xeeacf7c02430162b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127467.193687:0:15455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a9d083a/0xeeacf7c02430162b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127467.193696:0:15455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a9d083a/0xeeacf7c02430162b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127467.193703:0:15455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a9d083a/0xeeacf7c02430162b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127467.193731:0:15455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789127467.193955:0:14758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789127467.193962:0:14758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a9d083a/0xeeacf7c02430162b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127467.193970:0:14758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd97800 already unused, calling callback (ffffffffc17a4550) 00010000:00010000:3.0:1789127467.193973:0:14758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a9d083a/0xeeacf7c02430162b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127467.193982:0:14758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a9d083a/0xeeacf7c02430162b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127467.194004:0:14758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a9d083a/0xeeacf7c02430162b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127467.194011:0:14758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a9d083a/0xeeacf7c02430162b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127467.194029:0:14758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127467.194031:0:14758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127467.194032:0:14758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789127467.195580:0:15455:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789127467.195592:0:15455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e558dd3e/0xeeacf7c024301632 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127467.195607:0:15455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=413s v=(0 0) 00010000:00010000:1.0:1789127467.195611:0:15455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789127467.195617:0:15455:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e558dd3e/0xeeacf7c024301632 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127467.195629:0:15455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e558dd3e/0xeeacf7c024301632 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127467.195638:0:15455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e558dd3e/0xeeacf7c024301632 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127467.195656:0:15455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e558dd3e/0xeeacf7c024301632 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127467.195680:0:15455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789127467.197549:0:15455:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789127467.197560:0:15455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f16675ae/0xeeacf7c024301639 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127467.197575:0:15455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=413s v=(0 0) 00010000:00010000:1.0:1789127467.197580:0:15455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789127467.197586:0:15455:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f16675ae/0xeeacf7c024301639 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127467.197598:0:15455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f16675ae/0xeeacf7c024301639 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127467.197609:0:15455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f16675ae/0xeeacf7c024301639 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127467.197617:0:15455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f16675ae/0xeeacf7c024301639 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127467.197633:0:15455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1789127467.198023:0:15455:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789127467.198029:0:15455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039d1d77c/0xeeacf7c024301640 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127467.198043:0:15455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=413s v=(0 0) 00010000:00010000:1.0:1789127467.198047:0:15455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789127467.198051:0:15455:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000039d1d77c/0xeeacf7c024301640 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127467.198060:0:15455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000039d1d77c/0xeeacf7c024301640 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127467.198068:0:15455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039d1d77c/0xeeacf7c024301640 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127467.198075:0:15455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000039d1d77c/0xeeacf7c024301640 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127467.198084:0:15455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1789127467.198494:0:14757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789127467.198503:0:14757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e558dd3e/0xeeacf7c024301632 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127467.198511:0:14757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd96c00 already unused, calling callback (ffffffffc17a4550) 00010000:00010000:3.0:1789127467.198515:0:14757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e558dd3e/0xeeacf7c024301632 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127467.198523:0:14757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e558dd3e/0xeeacf7c024301632 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127467.198539:0:14757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e558dd3e/0xeeacf7c024301632 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127467.198546:0:14757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e558dd3e/0xeeacf7c024301632 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127467.200537:0:14758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789127467.201372:0:14757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789127467.201381:0:14757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000039d1d77c/0xeeacf7c024301640 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127467.201395:0:14757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd96600 already unused, calling callback (ffffffffc17a4550) 00010000:00010000:3.0:1789127467.201399:0:14757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000039d1d77c/0xeeacf7c024301640 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127467.201411:0:14757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000039d1d77c/0xeeacf7c024301640 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127467.201431:0:14757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000039d1d77c/0xeeacf7c024301640 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127467.201439:0:14757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000039d1d77c/0xeeacf7c024301640 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127467.201468:0:14757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127467.201470:0:14757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127467.201472:0:14757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127467.203119:0:16036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127467.203123:0:16036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127467.203126:0:16036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127467.203160:0:14758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f16675ae/0xeeacf7c024301639 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127467.203179:0:14758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd97400 already unused, calling callback (ffffffffc17a4550) 00010000:00010000:2.0:1789127467.203183:0:14758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f16675ae/0xeeacf7c024301639 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127467.203202:0:14758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f16675ae/0xeeacf7c024301639 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127467.203223:0:14758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f16675ae/0xeeacf7c024301639 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127467.203230:0:14758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f16675ae/0xeeacf7c024301639 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127467.203258:0:14758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127467.203260:0:14758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127467.203261:0:14758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789127467.203940:0:15455:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789127467.203948:0:15455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021aea5c8/0xeeacf7c024301647 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127467.203961:0:15455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=413s v=(0 0) 00010000:00010000:1.0:1789127467.203965:0:15455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789127467.203971:0:15455:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021aea5c8/0xeeacf7c024301647 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127467.203983:0:15455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000021aea5c8/0xeeacf7c024301647 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127467.204004:0:15455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021aea5c8/0xeeacf7c024301647 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127467.204013:0:15455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000021aea5c8/0xeeacf7c024301647 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127467.204037:0:15455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789127467.204214:0:14757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789127467.204221:0:14757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000021aea5c8/0xeeacf7c024301647 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127467.204229:0:14757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd97000 already unused, calling callback (ffffffffc17a4550) 00010000:00010000:3.0:1789127467.204238:0:14757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000021aea5c8/0xeeacf7c024301647 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127467.204247:0:14757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000021aea5c8/0xeeacf7c024301647 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127467.204260:0:14757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000021aea5c8/0xeeacf7c024301647 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127467.204268:0:14757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021aea5c8/0xeeacf7c024301647 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127467.204282:0:14757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127467.204284:0:14757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127467.204285:0:14757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789127467.205752:0:15455:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789127467.205761:0:15455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006153314d/0xeeacf7c02430164e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127467.205774:0:15455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=413s v=(0 0) 00010000:00010000:1.0:1789127467.205778:0:15455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789127467.205784:0:15455:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006153314d/0xeeacf7c02430164e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127467.205815:0:15455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006153314d/0xeeacf7c02430164e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127467.205824:0:15455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006153314d/0xeeacf7c02430164e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127467.205831:0:15455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006153314d/0xeeacf7c02430164e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127467.205860:0:15455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789127467.205885:0:16036:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789127467.205892:0:16036:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006153314d/0xeeacf7c02430164e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127467.205900:0:16036:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd96e00 already unused, calling callback (ffffffffc17a4550) 00010000:00010000:0.0:1789127467.205903:0:16036:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006153314d/0xeeacf7c02430164e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127467.205911:0:16036:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006153314d/0xeeacf7c02430164e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127467.205932:0:16036:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006153314d/0xeeacf7c02430164e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127467.205939:0:16036:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006153314d/0xeeacf7c02430164e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127467.205955:0:16036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127467.205956:0:16036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127467.205958:0:16036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789127467.207837:0:15455:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789127467.207851:0:15455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000701e5841/0xeeacf7c024301655 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127467.207864:0:15455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=413s v=(0 0) 00010000:00010000:0.0:1789127467.207868:0:15455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789127467.207874:0:15455:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000701e5841/0xeeacf7c024301655 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127467.207886:0:15455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000701e5841/0xeeacf7c024301655 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127467.207896:0:15455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000701e5841/0xeeacf7c024301655 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127467.207904:0:15455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000701e5841/0xeeacf7c024301655 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127467.207937:0:15455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789127467.207992:0:14758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789127467.208000:0:14758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000701e5841/0xeeacf7c024301655 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127467.208008:0:14758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7ae729000 already unused, calling callback (ffffffffc17a4550) 00010000:00010000:2.0:1789127467.208012:0:14758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000701e5841/0xeeacf7c024301655 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127467.208021:0:14758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000701e5841/0xeeacf7c024301655 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127467.208036:0:14758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000701e5841/0xeeacf7c024301655 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127467.208043:0:14758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000701e5841/0xeeacf7c024301655 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127467.208059:0:14758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127467.208061:0:14758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127467.208062:0:14758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789127467.208422:0:15455:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789127467.208427:0:15455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000acbca3e3/0xeeacf7c02430165c lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127467.208435:0:15455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=413s v=(0 0) 00010000:00010000:0.0:1789127467.208438:0:15455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789127467.208443:0:15455:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000acbca3e3/0xeeacf7c02430165c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127467.208452:0:15455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000acbca3e3/0xeeacf7c02430165c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127467.208459:0:15455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000acbca3e3/0xeeacf7c02430165c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127467.208466:0:15455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000acbca3e3/0xeeacf7c02430165c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127467.208487:0:15455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789127467.208510:0:14757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789127467.208516:0:14757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000acbca3e3/0xeeacf7c02430165c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127467.208524:0:14757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7ae729400 already unused, calling callback (ffffffffc17a4550) 00010000:00010000:1.0:1789127467.208527:0:14757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000acbca3e3/0xeeacf7c02430165c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127467.208535:0:14757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000acbca3e3/0xeeacf7c02430165c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127467.208547:0:14757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000acbca3e3/0xeeacf7c02430165c lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127467.208554:0:14757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000acbca3e3/0xeeacf7c02430165c lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127467.208568:0:14757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127467.208569:0:14757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127467.208571:0:14757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789127467.208898:0:15455:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789127467.208904:0:15455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d049aa09/0xeeacf7c024301663 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127467.208912:0:15455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=413s v=(0 0) 00010000:00010000:0.0:1789127467.208921:0:15455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789127467.208925:0:15455:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d049aa09/0xeeacf7c024301663 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127467.208935:0:15455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d049aa09/0xeeacf7c024301663 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127467.208943:0:15455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d049aa09/0xeeacf7c024301663 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127467.208949:0:15455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d049aa09/0xeeacf7c024301663 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127467.208969:0:15455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789127467.209126:0:16036:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789127467.209132:0:16036:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d049aa09/0xeeacf7c024301663 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127467.209150:0:16036:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7ae728600 already unused, calling callback (ffffffffc17a4550) 00010000:00010000:2.0:1789127467.209153:0:16036:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d049aa09/0xeeacf7c024301663 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127467.209161:0:16036:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d049aa09/0xeeacf7c024301663 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127467.209174:0:16036:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d049aa09/0xeeacf7c024301663 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127467.209180:0:16036:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d049aa09/0xeeacf7c024301663 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127467.209203:0:16036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127467.209205:0:16036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127467.209206:0:16036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789127467.209381:0:15455:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789127467.209387:0:15455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e724354/0xeeacf7c02430166a lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127467.209396:0:15455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=413s v=(0 0) 00010000:00010000:0.0:1789127467.209399:0:15455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789127467.209403:0:15455:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e724354/0xeeacf7c02430166a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127467.209413:0:15455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e724354/0xeeacf7c02430166a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127467.209420:0:15455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e724354/0xeeacf7c02430166a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127467.209433:0:15455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006e724354/0xeeacf7c02430166a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127467.209451:0:15455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789127467.209587:0:14758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789127467.209592:0:14758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006e724354/0xeeacf7c02430166a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127467.209600:0:14758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7ae728000 already unused, calling callback (ffffffffc17a4550) 00010000:00010000:2.0:1789127467.209603:0:14758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006e724354/0xeeacf7c02430166a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127467.209611:0:14758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006e724354/0xeeacf7c02430166a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127467.209628:0:14758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006e724354/0xeeacf7c02430166a lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127467.209635:0:14758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e724354/0xeeacf7c02430166a lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127467.209647:0:14758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127467.209649:0:14758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127467.209651:0:14758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789127467.210568:0:15455:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789127467.210577:0:15455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067de6d11/0xeeacf7c024301671 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127467.210588:0:15455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=413s v=(0 0) 00010000:00010000:2.0:1789127467.210591:0:15455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127467.210596:0:15455:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067de6d11/0xeeacf7c024301671 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127467.210608:0:15455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067de6d11/0xeeacf7c024301671 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127467.210616:0:15455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067de6d11/0xeeacf7c024301671 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127467.210622:0:15455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067de6d11/0xeeacf7c024301671 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127467.210652:0:15455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789127467.211035:0:15455:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789127467.211040:0:15455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000585ad900/0xeeacf7c024301678 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127467.211048:0:15455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=413s v=(0 0) 00010000:00010000:2.0:1789127467.211050:0:15455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127467.211054:0:15455:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000585ad900/0xeeacf7c024301678 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127467.211062:0:15455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000585ad900/0xeeacf7c024301678 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127467.211069:0:15455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000585ad900/0xeeacf7c024301678 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127467.211076:0:15455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000585ad900/0xeeacf7c024301678 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127467.211091:0:15455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789127467.211100:0:16036:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789127467.211105:0:16036:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067de6d11/0xeeacf7c024301671 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127467.211111:0:16036:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7aeab7e00 already unused, calling callback (ffffffffc17a4550) 00010000:00010000:2.0:1789127467.211120:0:16036:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067de6d11/0xeeacf7c024301671 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127467.211129:0:16036:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067de6d11/0xeeacf7c024301671 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127467.211143:0:16036:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067de6d11/0xeeacf7c024301671 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127467.211150:0:16036:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067de6d11/0xeeacf7c024301671 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127467.211164:0:16036:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789127467.211168:0:16036:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000585ad900/0xeeacf7c024301678 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127467.211174:0:16036:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7aeab6600 already unused, calling callback (ffffffffc17a4550) 00010000:00010000:2.0:1789127467.211178:0:16036:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000585ad900/0xeeacf7c024301678 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127467.211185:0:16036:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000585ad900/0xeeacf7c024301678 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127467.211309:0:14757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127467.211547:0:16036:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000585ad900/0xeeacf7c024301678 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127467.211556:0:16036:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000585ad900/0xeeacf7c024301678 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127467.211575:0:16036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127467.211576:0:16036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127467.211578:0:16036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789127467.212005:0:15455:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789127467.212012:0:15455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008517d3fa/0xeeacf7c02430167f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127467.212021:0:15455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=413s v=(0 0) 00010000:00010000:2.0:1789127467.212024:0:15455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127467.212029:0:15455:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008517d3fa/0xeeacf7c02430167f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127467.212039:0:15455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008517d3fa/0xeeacf7c02430167f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127467.212047:0:15455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008517d3fa/0xeeacf7c02430167f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127467.212054:0:15455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008517d3fa/0xeeacf7c02430167f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127467.212069:0:15455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789127467.212078:0:14758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789127467.212082:0:14758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008517d3fa/0xeeacf7c02430167f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127467.212099:0:14758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7aeab6000 already unused, calling callback (ffffffffc17a4550) 00010000:00010000:2.0:1789127467.212104:0:14758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008517d3fa/0xeeacf7c02430167f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127467.212111:0:14758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008517d3fa/0xeeacf7c02430167f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127467.212122:0:14758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008517d3fa/0xeeacf7c02430167f lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127467.212129:0:14758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008517d3fa/0xeeacf7c02430167f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127467.212143:0:14758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127467.212144:0:14758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127467.212146:0:14758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789127467.215338:0:15455:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789127467.215355:0:15455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af70175f/0xeeacf7c024301686 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127467.215372:0:15455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=413s v=(0 0) 00010000:00010000:2.0:1789127467.215377:0:15455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127467.215384:0:15455:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af70175f/0xeeacf7c024301686 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127467.215522:0:15455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000af70175f/0xeeacf7c024301686 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127467.215546:0:15455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af70175f/0xeeacf7c024301686 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127467.215554:0:15455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000af70175f/0xeeacf7c024301686 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127467.215574:0:15455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789127467.218576:0:14757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789127467.218588:0:14757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000af70175f/0xeeacf7c024301686 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127467.218615:0:14757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7aeab7800 already unused, calling callback (ffffffffc17a4550) 00002000:00010000:2.0:1789127467.218618:0:15455:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789127467.218620:0:14757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000af70175f/0xeeacf7c024301686 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127467.218625:0:15455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb9ec4a2/0xeeacf7c02430168d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127467.218631:0:14757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000af70175f/0xeeacf7c024301686 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127467.218635:0:15455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=413s v=(0 0) 00010000:00010000:2.0:1789127467.218639:0:15455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127467.218645:0:15455:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb9ec4a2/0xeeacf7c02430168d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127467.218649:0:14757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000af70175f/0xeeacf7c024301686 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127467.218656:0:15455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb9ec4a2/0xeeacf7c02430168d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127467.218656:0:14757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000af70175f/0xeeacf7c024301686 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127467.218666:0:15455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb9ec4a2/0xeeacf7c02430168d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127467.218673:0:15455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bb9ec4a2/0xeeacf7c02430168d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127467.218674:0:14757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127467.218676:0:14757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127467.218678:0:14757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127467.218714:0:15455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789127467.219363:0:15455:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789127467.219371:0:15455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed4b279c/0xeeacf7c024301694 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127467.219381:0:15455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=413s v=(0 0) 00010000:00010000:2.0:1789127467.219385:0:15455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127467.219389:0:15455:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed4b279c/0xeeacf7c024301694 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127467.219463:0:15455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ed4b279c/0xeeacf7c024301694 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127467.219472:0:15455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed4b279c/0xeeacf7c024301694 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127467.219479:0:15455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ed4b279c/0xeeacf7c024301694 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127467.219498:0:15455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789127467.219510:0:14758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789127467.219515:0:14758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bb9ec4a2/0xeeacf7c02430168d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127467.219522:0:14758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7aeab6400 already unused, calling callback (ffffffffc17a4550) 00010000:00010000:2.0:1789127467.219532:0:14758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb9ec4a2/0xeeacf7c02430168d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127467.219541:0:14758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb9ec4a2/0xeeacf7c02430168d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127467.219555:0:14758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bb9ec4a2/0xeeacf7c02430168d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127467.219562:0:14758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb9ec4a2/0xeeacf7c02430168d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127467.219576:0:14758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789127467.219580:0:14758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ed4b279c/0xeeacf7c024301694 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127467.219586:0:14758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7aeab7a00 already unused, calling callback (ffffffffc17a4550) 00010000:00010000:2.0:1789127467.219589:0:14758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed4b279c/0xeeacf7c024301694 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127467.219596:0:14758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed4b279c/0xeeacf7c024301694 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127467.219605:0:14758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ed4b279c/0xeeacf7c024301694 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127467.219613:0:14758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed4b279c/0xeeacf7c024301694 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127467.219630:0:14758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127467.219632:0:14758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127467.219634:0:14758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789127467.220059:0:15455:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789127467.220065:0:15455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001e7bb45/0xeeacf7c02430169b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127467.220074:0:15455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=413s v=(0 0) 00010000:00010000:2.0:1789127467.220078:0:15455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127467.220083:0:15455:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001e7bb45/0xeeacf7c02430169b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127467.220092:0:15455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001e7bb45/0xeeacf7c02430169b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127467.220099:0:15455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001e7bb45/0xeeacf7c02430169b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127467.220106:0:15455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001e7bb45/0xeeacf7c02430169b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127467.220118:0:15455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789127467.220945:0:16036:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789127467.220954:0:16036:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001e7bb45/0xeeacf7c02430169b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127467.220964:0:16036:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7aeab6a00 already unused, calling callback (ffffffffc17a4550) 00010000:00010000:1.0:1789127467.220968:0:16036:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001e7bb45/0xeeacf7c02430169b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127467.220977:0:16036:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001e7bb45/0xeeacf7c02430169b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127467.220998:0:16036:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001e7bb45/0xeeacf7c02430169b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127467.221007:0:16036:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001e7bb45/0xeeacf7c02430169b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127467.221025:0:16036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127467.221026:0:16036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127467.221028:0:16036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127467.221035:0:14757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1789127467.221853:0:15455:0:(ofd_dev.c:1532:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:2.0:1789127467.221995:0:15455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6820bfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14792:x1876035752790016:12345-0@lo:5:osp-pre-0-0.0 Request processed in 147097us (151276us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127467.222011:0:15455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789127467.222668:0:14792:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6820bde00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14792:1876035752790016:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1789127467.222684:0:14792:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:1.0:1789127467.222725:0:14792:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae2fa940 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14792:1876035752790144:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1789127467.222765:0:14792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127467.222891:0:14792:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df79a197cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789127467.223885:0:15456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752790144 00000100:00100000:2.0:1789127467.223894:0:15456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752790144 00000100:00100000:2.0:1789127467.223982:0:15456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789127467.223991:0:15456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae2fb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14792:x1876035752790144:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1789127467.224033:0:15456:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:2.0:1789127467.233333:0:15456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae2fb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14792:x1876035752790144:12345-0@lo:5:osp-pre-0-0.0 Request processed in 9335us (10559us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1789127467.233346:0:15456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789127467.233556:0:14792:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae2fa940 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14792:1876035752790144:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1789127467.233571:0:14792:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:2.0:1789127467.771638:0:14758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127468.790425:0:16036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127469.810969:0:14757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789127469.817680:0:16175:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789127469.817685:0:16175:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1789127469.817856:0:16175:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8df791481000 00000020:01000004:2.0:1789127469.817871:0:16175:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1789127469.817883:0:16175:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1789127469.817895:0:16175:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8df790234ed8) 00000020:00000080:2.0:1789127469.817920:0:16175:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1789127469.853105:0:16175:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1789127469.858473:0:16175:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1789127469.862320:0:16175:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1789127469.862544:0:16175:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1789127469.862996:0:16175:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1789127469.863437:0:16175:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 409: rc = 0 00100000:10000000:0.0:1789127469.863575:0:16175:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 409: rc = 0 00100000:10000000:0.0:1789127469.864021:0:16175:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 409: rc = 0 00100000:10000000:0.0:1789127469.865270:0:16175:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 378: rc = 0 00100000:10000000:0.0:1789127469.865536:0:16175:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 378: rc = 0 00100000:10000000:1.0:1789127469.867357:0:16175:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 378: rc = 0 00100000:10000000:1.0:1789127469.867706:0:16175:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 378: rc = 0 00100000:10000000:1.0:1789127469.868303:0:16175:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 378: rc = 0 00100000:10000000:1.0:1789127469.868579:0:16175:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 378: rc = 0 00000020:00000080:1.0:1789127469.869444:0:16175:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1789127469.869456:0:16175:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789127469.869468:0:16175:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xeeacf7c0243016a9 00000020:01000004:1.0:1789127469.869474:0:16175:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:1.0:1789127469.869501:0:16175:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.140@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1789127469.869504:0:16175:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.140@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1789127469.869509:0:16175:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1789127469.869529:0:16175:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:1.0:1789127469.869533:0:16175:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.140@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1789127469.906492:0:16175:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.140@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789127469.906541:0:16175:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.140@tcp, index=0001, flags=0x20002 00000020:01000004:0.0:1789127469.906545:0:16175:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789127469.906547:0:16175:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789127469.906549:0:16175:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789127469.906550:0:16175:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789127469.906551:0:16175:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789127469.906552:0:16175:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789127469.906553:0:16175:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789127469.906555:0:16175:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789127469.906556:0:16175:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789127469.906560:0:16175:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:0.0:1789127469.906562:0:16175:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789127469.906564:0:16175:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789127469.906565:0:16175:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789127469.906566:0:16175:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789127469.906567:0:16175:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789127469.908964:0:16175:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789127469.908966:0:16175:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789127469.908968:0:16175:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789127469.908969:0:16175:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789127469.908997:0:16175:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1789127469.909018:0:16175:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6820bda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:16175:1876035752790272:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789127469.909094:0:16175:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127469.909230:0:14763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752790272 00000100:00100000:3.0:1789127469.909237:0:14763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752790272 00000100:00100000:3.0:1789127469.909295:0:14763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789127469.909305:0:14763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7af251050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:396611f1-c34a-4e5a-8396-03624226b0e0+16:16175:x1876035752790272:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789127469.909333:0:14763:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1789127469.909336:0:14763:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1789127469.909340:0:14763:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1789127469.909364:0:16175:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df79021a540 going to sleep for 11 seconds 00000100:00100000:2.0:1789127469.956698:0:14763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7af251050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:396611f1-c34a-4e5a-8396-03624226b0e0+16:16175:x1876035752790272:12345-0@lo:253:mount.lustre.0 Request processed in 47384us (47595us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127469.956712:0:14763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789127469.956979:0:16175:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6820bda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:16175:1876035752790272:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789127469.956995:0:16175:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1789127469.956998:0:16175:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789127469.957000:0:16175:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789127469.957001:0:16175:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789127469.957002:0:16175:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789127469.957003:0:16175:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789127469.957005:0:16175:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789127469.957006:0:16175:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789127469.957008:0:16175:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789127469.957009:0:16175:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789127469.957030:0:16175:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8df791481000 from lustre-OST0001 10000000:01000000:0.0:1789127469.957053:0:16175:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1789127469.957056:0:16175:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1789127469.957062:0:16175:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8df790230000 local copy 00010000:00010000:0.0:1789127469.957072:0:16175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df7c2050c00/0xeeacf7c02430144f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c024301456 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127469.957476:0:16175:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6820bda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:16175:1876035752790400:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789127469.957524:0:16175:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127469.957567:0:16175:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df79021a600 going to sleep for 11 seconds 00000100:00100000:2.0:1789127469.957744:0:14761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752790400 00000100:00100000:2.0:1789127469.957749:0:14761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752790400 00000100:00100000:2.0:1789127469.957866:0:14761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789127469.957875:0:14761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7af251850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:396611f1-c34a-4e5a-8396-03624226b0e0+16:16175:x1876035752790400:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789127469.958049:0:14761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7af251850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:396611f1-c34a-4e5a-8396-03624226b0e0+16:16175:x1876035752790400:12345-0@lo:501:mount.lustre.0 Request processed in 174us (524us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789127469.958056:0:14761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789127469.958147:0:16175:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6820bda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:16175:1876035752790400:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1789127469.958163:0:16175:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.140@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789127469.958319:0:16175:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.140@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789127469.958332:0:16175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df7c2050c00/0xeeacf7c02430144f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c024301456 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127469.958341:0:16175:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff8df7c2050c00/0xeeacf7c02430144f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c024301456 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127469.958360:0:16175:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8df791481000 10000000:01000000:0.0:1789127469.958363:0:16175:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789127469.958368:0:16175:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1789127469.958370:0:16175:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789127469.958374:0:16175:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1789127469.958376:0:16175:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1789127469.958398:0:16175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df7ae728e00/0xeeacf7c0243016b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127469.958406:0:16175:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff8df7ae728e00/0xeeacf7c0243016b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127469.958414:0:16175:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff8df7ae728e00/0xeeacf7c0243016b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127469.958427:0:16175:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6820bda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:16175:1876035752790528:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789127469.958456:0:16175:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127469.962780:0:16175:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df79021a600 going to sleep for 11 seconds 00000100:00100000:1.0:1789127469.963309:0:14764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752790528 00000100:00100000:1.0:1789127469.963318:0:14764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752790528 00000100:00100000:1.0:1789127469.963367:0:14764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789127469.963376:0:14764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7af250050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:396611f1-c34a-4e5a-8396-03624226b0e0+16:16175:x1876035752790528:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789127469.963393:0:14764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127469.963411:0:14764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df7bbd97600/0xeeacf7c0243016b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xeeacf7c0243016b0 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127469.963436:0:14764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df7bbd97600/0xeeacf7c0243016b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xeeacf7c0243016b0 expref: 17 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127469.963447:0:14764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df7bbd97600/0xeeacf7c0243016b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c0243016b0 expref: 17 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127469.963456:0:14764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7bbd97600, rc 0) 00000100:00100000:1.0:1789127469.963523:0:14764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7af250050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:396611f1-c34a-4e5a-8396-03624226b0e0+17:16175:x1876035752790528:12345-0@lo:101:mount.lustre.0 Request processed in 148us (5065us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127469.963531:0:14764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789127469.963661:0:16175:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6820bda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:16175:1876035752790528:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789127469.963679:0:16175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff8df7ae728e00/0xeeacf7c0243016b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c0243016b7 expref: -99 pid: 16175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127469.963687:0:16175:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff8df7ae728e00/0xeeacf7c0243016b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xeeacf7c0243016b7 expref: -99 pid: 16175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789127469.964864:0:16175:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1789127469.971778:0:16175:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789127469.973087:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1789127469.973718:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1789127469.973770:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1789127469.973866:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1789127469.974025:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1789127469.974064:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1789127469.974441:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1789127469.974452:0:16175:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1789127469.974552:0:16175:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae2f8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:16175:1876035752790656:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789127469.975110:0:16175:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127469.975298:0:16175:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7aea33a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789127469.975711:0:14764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752790656 00000100:00100000:3.0:1789127469.975729:0:14764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752790656 00000100:00100000:3.0:1789127469.975784:0:14764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789127469.975825:0:14764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7af251450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:396611f1-c34a-4e5a-8396-03624226b0e0+17:16175:x1876035752790656:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789127469.977264:0:14764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7af251450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:396611f1-c34a-4e5a-8396-03624226b0e0+17:16175:x1876035752790656:12345-0@lo:501:mount.lustre.0 Request processed in 1438us (2150us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127469.977276:0:14764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789127469.977400:0:16175:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae2f8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:16175:1876035752790656:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789127469.977446:0:16175:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae2f8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:16175:1876035752790784:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789127469.977495:0:16175:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127469.977533:0:16175:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7aea33a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789127469.978017:0:14761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752790784 00000100:00100000:2.0:1789127469.978023:0:14761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752790784 00000100:00100000:2.0:1789127469.978071:0:14761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789127469.978089:0:14761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7af252c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:396611f1-c34a-4e5a-8396-03624226b0e0+17:16175:x1876035752790784:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789127469.978521:0:14761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7af252c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:396611f1-c34a-4e5a-8396-03624226b0e0+17:16175:x1876035752790784:12345-0@lo:503:mount.lustre.0 Request processed in 434us (1025us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127469.978529:0:14761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789127469.979104:0:16175:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae2f8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:16175:1876035752790784:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789127469.981261:0:16175:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789127469.981356:0:16175:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae2f8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:16175:1876035752790912:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789127469.981439:0:16175:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127469.981489:0:16175:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7aea33a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789127469.982076:0:14764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752790912 00000100:00100000:3.0:1789127469.982083:0:14764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752790912 00000100:00100000:3.0:1789127469.982140:0:14764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789127469.982150:0:14764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7af252850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:396611f1-c34a-4e5a-8396-03624226b0e0+17:16175:x1876035752790912:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789127469.982393:0:14764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7af252850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:396611f1-c34a-4e5a-8396-03624226b0e0+17:16175:x1876035752790912:12345-0@lo:502:mount.lustre.0 Request processed in 244us (953us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127469.982402:0:14764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789127469.983041:0:16175:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae2f8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:16175:1876035752790912:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789127469.983445:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1789127469.983498:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1789127469.983528:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1789127469.983578:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1789127469.983609:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1789127469.983635:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1789127469.983670:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1789127469.983697:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1789127469.983737:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1789127469.983768:0:16175:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae2f8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:16175:1876035752791040:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789127469.983869:0:16175:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127469.986756:0:14763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752791040 00000100:00100000:3.0:1789127469.986770:0:14763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752791040 00000100:00100000:3.0:1789127469.986854:0:14763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789127469.986865:0:14763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7af251c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:396611f1-c34a-4e5a-8396-03624226b0e0+17:16175:x1876035752791040:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789127469.989251:0:14763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7af251c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:396611f1-c34a-4e5a-8396-03624226b0e0+17:16175:x1876035752791040:12345-0@lo:502:mount.lustre.0 Request processed in 2380us (5375us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127469.989263:0:14763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789127469.989999:0:16175:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7aea33a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789127469.990032:0:16175:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae2f8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:16175:1876035752791040:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789127469.991009:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1789127469.991030:0:16175:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:2.0:1789127469.996326:0:16176:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789127469.996339:0:16176:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1789127469.996346:0:16176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127469.996348:0:16176:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1789127469.996354:0:16176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789127469.996385:0:16176:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8df6833ab490) 00000020:00000080:2.0:1789127469.996407:0:16176:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789127469.996414:0:16176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789127469.996484:0:16176:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8df791481000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1789127469.996493:0:16176:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789127469.996500:0:16176:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xeeacf7c0243016c5 00010000:00010000:2.0:1789127470.000268:0:16176:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:2.0:1789127470.000629:0:16176:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:2.0:1789127470.002559:0:16176:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xc:0x0] (8/8/4) registered 00000020:00000080:0.0:1789127470.004728:0:16176:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1789127470.004739:0:16176:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789127470.004745:0:16176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127470.004747:0:16176:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1789127470.004750:0:16176:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789127470.004754:0:16176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127470.004755:0:16176:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789127470.004759:0:16176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789127470.004761:0:16176:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789127470.004763:0:16176:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789127470.004765:0:16176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127470.004767:0:16176:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789127470.004769:0:16176:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789127470.004771:0:16176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127470.004772:0:16176:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789127470.004775:0:16176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1789127470.004829:0:16176:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789127470.004832:0:16176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127470.004834:0:16176:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789127470.004837:0:16176:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:1.0:1789127470.007244:0:16175:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1789127470.007282:0:16175:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1789127470.007346:0:16175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df7ae728e00/0xeeacf7c0243016b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c0243016b7 expref: -99 pid: 16175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127470.007358:0:16175:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff8df7ae728e00/0xeeacf7c0243016b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c0243016b7 expref: -99 pid: 16175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127470.012973:0:16175:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df791481000 from 1 10000000:01000000:0.0:1789127470.012982:0:16175:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789127470.013030:0:16175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df7ae729c00/0xeeacf7c0243016cc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127470.013041:0:16175:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff8df7ae729c00/0xeeacf7c0243016cc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127470.013053:0:16175:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff8df7ae729c00/0xeeacf7c0243016cc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127470.013095:0:16175:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6820bda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:16175:1876035752791168:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789127470.013185:0:16175:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127470.013226:0:16175:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df79021ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1789127470.013370:0:14761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752791168 00000100:00100000:2.0:1789127470.013378:0:14761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752791168 00000100:00100000:2.0:1789127470.013436:0:14761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789127470.013445:0:14761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7af252450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:396611f1-c34a-4e5a-8396-03624226b0e0+17:16175:x1876035752791168:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789127470.013457:0:14761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127470.013469:0:14761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df7aeab7e00/0xeeacf7c0243016d3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xeeacf7c0243016cc expref: -99 pid: 14761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127470.013491:0:14761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df7aeab7e00/0xeeacf7c0243016d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xeeacf7c0243016cc expref: 18 pid: 14761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127470.013501:0:14761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df7aeab7e00/0xeeacf7c0243016d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c0243016cc expref: 18 pid: 14761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127470.013517:0:14761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7aeab7e00, rc 0) 00000100:00100000:2.0:1789127470.013558:0:14761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7af252450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:396611f1-c34a-4e5a-8396-03624226b0e0+18:16175:x1876035752791168:12345-0@lo:101:mount.lustre.0 Request processed in 114us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127470.013565:0:14761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789127470.014256:0:16175:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6820bda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:16175:1876035752791168:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789127470.014274:0:16175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff8df7ae729c00/0xeeacf7c0243016cc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c0243016d3 expref: -99 pid: 16175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127470.014283:0:16175:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff8df7ae729c00/0xeeacf7c0243016cc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xeeacf7c0243016d3 expref: -99 pid: 16175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789127470.014732:0:16175:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1789127470.015265:0:16175:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789127470.015486:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1789127470.015525:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1789127470.015577:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1789127470.015583:0:16175:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1789127470.015640:0:16175:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6820bda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:16175:1876035752791296:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789127470.015690:0:16175:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127470.015728:0:16175:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df79021ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1789127470.016251:0:14763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752791296 00000100:00100000:2.0:1789127470.016258:0:14763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752791296 00000100:00100000:2.0:1789127470.016299:0:14763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789127470.016307:0:14763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7af250c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:396611f1-c34a-4e5a-8396-03624226b0e0+18:16175:x1876035752791296:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789127470.016516:0:14763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7af250c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:396611f1-c34a-4e5a-8396-03624226b0e0+18:16175:x1876035752791296:12345-0@lo:501:mount.lustre.0 Request processed in 208us (823us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127470.016523:0:14763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789127470.017268:0:16175:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6820bda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:16175:1876035752791296:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789127470.017311:0:16175:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6820bda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:16175:1876035752791424:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789127470.017356:0:16175:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127470.017648:0:16175:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df79021ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1789127470.021992:0:14764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752791424 00000100:00100000:2.0:1789127470.022004:0:14764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752791424 00000100:00100000:2.0:1789127470.022098:0:14764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789127470.022109:0:14764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7af253c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:396611f1-c34a-4e5a-8396-03624226b0e0+18:16175:x1876035752791424:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789127470.022683:0:14764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7af253c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:396611f1-c34a-4e5a-8396-03624226b0e0+18:16175:x1876035752791424:12345-0@lo:503:mount.lustre.0 Request processed in 574us (5324us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127470.022693:0:14764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789127470.022782:0:16175:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6820bda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:16175:1876035752791424:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789127470.026482:0:16175:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789127470.026570:0:16175:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6820bda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:16175:1876035752791552:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789127470.026639:0:16175:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127470.026957:0:16175:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df79021ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1789127470.030034:0:14763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752791552 00000100:00100000:3.0:1789127470.030047:0:14763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752791552 00000100:00100000:3.0:1789127470.030102:0:14763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789127470.030110:0:14763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7af7ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:396611f1-c34a-4e5a-8396-03624226b0e0+18:16175:x1876035752791552:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789127470.030592:0:14763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7af7ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:396611f1-c34a-4e5a-8396-03624226b0e0+18:16175:x1876035752791552:12345-0@lo:502:mount.lustre.0 Request processed in 482us (3952us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127470.030611:0:14763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789127470.030711:0:16175:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6820bda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:16175:1876035752791552:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789127470.030995:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1789127470.031047:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1789127470.031115:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1789127470.031167:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1789127470.031216:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1789127470.031269:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1789127470.031323:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1789127470.031355:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 144 off9680 00000040:00080000:0.0:1789127470.031399:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9904 00000040:00080000:0.0:1789127470.031426:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10128 00000040:00080000:0.0:1789127470.031463:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10256 00000100:00100000:0.0:1789127470.031496:0:16175:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6820bda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:16175:1876035752791680:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789127470.031542:0:16175:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127470.031566:0:16175:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df79021ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1789127470.031692:0:14763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752791680 00000100:00100000:3.0:1789127470.031698:0:14763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752791680 00000100:00100000:3.0:1789127470.031724:0:14763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789127470.031730:0:14763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7af7cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:396611f1-c34a-4e5a-8396-03624226b0e0+18:16175:x1876035752791680:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789127470.031897:0:14763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7af7cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:396611f1-c34a-4e5a-8396-03624226b0e0+18:16175:x1876035752791680:12345-0@lo:502:mount.lustre.0 Request processed in 166us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127470.031903:0:14763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789127470.031987:0:16175:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6820bda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:16175:1876035752791680:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789127470.032049:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10480 00000040:00080000:0.0:1789127470.032058:0:16175:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1789127470.036490:0:16180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789127470.036503:0:16180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127470.036505:0:16180:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789127470.036513:0:16180:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8df791481000 00000020:00000080:0.0:1789127470.036515:0:16180:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789127470.036521:0:16180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789127470.036523:0:16180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127470.036524:0:16180:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789127470.036536:0:16180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789127470.036539:0:16180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127470.036540:0:16180:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789127470.036543:0:16180:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8df791481000 00000020:00000080:0.0:1789127470.036544:0:16180:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789127470.036630:0:16180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789127470.036633:0:16180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127470.036635:0:16180:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1789127470.036637:0:16180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789127470.036639:0:16180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127470.036640:0:16180:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:0.0:1789127470.036643:0:16180:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8df791481000 00000020:00000080:0.0:1789127470.036645:0:16180:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789127470.046931:0:16180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789127470.051398:0:16180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127470.051405:0:16180:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:0.0:1789127470.051415:0:16180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789127470.051421:0:16180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127470.051423:0:16180:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789127470.051427:0:16180:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8df791481000 00000020:00000080:0.0:1789127470.051430:0:16180:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789127470.051577:0:16180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789127470.051581:0:16180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127470.051583:0:16180:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1789127470.051586:0:16180:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:0.0:1789127470.053279:0:16175:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1789127470.053318:0:16175:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789127470.053336:0:16175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df7ae729c00/0xeeacf7c0243016cc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c0243016d3 expref: -99 pid: 16175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127470.053348:0:16175:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff8df7ae729c00/0xeeacf7c0243016cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c0243016d3 expref: -99 pid: 16175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127470.053400:0:16175:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789127470.053402:0:16175:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8df791481000 10000000:01000000:0.0:1789127470.053405:0:16175:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8df791481000 10000000:01000000:0.0:1789127470.053408:0:16175:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789127470.053412:0:16175:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8df791481000 from 1 10000000:01000000:0.0:1789127470.053415:0:16175:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789127470.053445:0:16175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df7ae729200/0xeeacf7c0243016da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127470.053452:0:16175:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff8df7ae729200/0xeeacf7c0243016da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127470.053462:0:16175:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff8df7ae729200/0xeeacf7c0243016da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127470.053484:0:16175:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6820bda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:16175:1876035752791808:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789127470.053542:0:16175:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127470.053583:0:16175:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df79021a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789127470.053694:0:14763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752791808 00000100:00100000:3.0:1789127470.053701:0:14763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752791808 00000100:00100000:3.0:1789127470.053746:0:14763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789127470.053754:0:14763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b404b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:396611f1-c34a-4e5a-8396-03624226b0e0+18:16175:x1876035752791808:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789127470.053767:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127470.053779:0:14763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df7c2051c00/0xeeacf7c0243016e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xeeacf7c0243016da expref: -99 pid: 14763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127470.053921:0:14763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df7c2051c00/0xeeacf7c0243016e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xeeacf7c0243016da expref: 19 pid: 14763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127470.053933:0:14763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df7c2051c00/0xeeacf7c0243016e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c0243016da expref: 19 pid: 14763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127470.053940:0:14763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7c2051c00, rc 0) 00000100:00100000:3.0:1789127470.053976:0:14763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b404b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:396611f1-c34a-4e5a-8396-03624226b0e0+19:16175:x1876035752791808:12345-0@lo:101:mount.lustre.0 Request processed in 223us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127470.053983:0:14763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789127470.055348:0:16175:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6820bda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:16175:1876035752791808:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789127470.055371:0:16175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff8df7ae729200/0xeeacf7c0243016da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c0243016e1 expref: -99 pid: 16175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127470.055382:0:16175:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff8df7ae729200/0xeeacf7c0243016da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xeeacf7c0243016e1 expref: -99 pid: 16175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789127470.055980:0:16175:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:0.0:1789127470.056356:0:16175:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789127470.056597:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1789127470.056646:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1789127470.056678:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1789127470.056723:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1789127470.056759:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1789127470.056833:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1789127470.056871:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1789127470.056922:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1789127470.056970:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1789127470.057003:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1789127470.057035:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1789127470.057093:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1789127470.057129:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1789127470.058362:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1789127470.058442:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1789127470.058476:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1789127470.058508:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1789127470.058554:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1789127470.058588:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1789127470.058621:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1789127470.058667:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1789127470.058703:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1789127470.058743:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1789127470.061379:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1789127470.061481:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1789127470.061518:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1789127470.061574:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1789127470.061609:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1789127470.061641:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1789127470.061684:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:0.0:1789127470.062344:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:0.0:1789127470.062379:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:0.0:1789127470.062407:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:0.0:1789127470.062454:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:0.0:1789127470.062497:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:0.0:1789127470.062538:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:0.0:1789127470.062568:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:0.0:1789127470.062652:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:0.0:1789127470.062659:0:16175:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:0.0:1789127470.062745:0:16175:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6820bda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:16175:1876035752791936:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789127470.062824:0:16175:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127470.062866:0:16175:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df79021a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789127470.065302:0:14761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752791936 00000100:00100000:2.0:1789127470.065316:0:14761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752791936 00000100:00100000:2.0:1789127470.065374:0:14761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789127470.065382:0:14761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b4049050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:396611f1-c34a-4e5a-8396-03624226b0e0+19:16175:x1876035752791936:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789127470.065675:0:14761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b4049050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:396611f1-c34a-4e5a-8396-03624226b0e0+19:16175:x1876035752791936:12345-0@lo:501:mount.lustre.0 Request processed in 293us (2850us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127470.065683:0:14761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789127470.065964:0:16175:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6820bda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:16175:1876035752791936:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789127470.066019:0:16175:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6820bda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:16175:1876035752792064:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789127470.066062:0:16175:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127470.066094:0:16175:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df79021a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789127470.069996:0:14764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752792064 00000100:00100000:2.0:1789127470.070010:0:14764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752792064 00000100:00100000:2.0:1789127470.070082:0:14764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789127470.070091:0:14764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b4049c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:396611f1-c34a-4e5a-8396-03624226b0e0+19:16175:x1876035752792064:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789127470.070341:0:14764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b4049c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:396611f1-c34a-4e5a-8396-03624226b0e0+19:16175:x1876035752792064:12345-0@lo:503:mount.lustre.0 Request processed in 250us (4278us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127470.070349:0:14764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789127470.075385:0:16175:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6820bda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:16175:1876035752792064:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789127470.075948:0:16175:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789127470.076033:0:16175:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6820bda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:16175:1876035752792192:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789127470.076099:0:16175:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127470.076139:0:16175:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df79021a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789127470.076318:0:14763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752792192 00000100:00100000:1.0:1789127470.076325:0:14763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752792192 00000100:00100000:1.0:1789127470.076372:0:14763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789127470.076380:0:14763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b4048c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:396611f1-c34a-4e5a-8396-03624226b0e0+19:16175:x1876035752792192:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789127470.076585:0:14763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b4048c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:396611f1-c34a-4e5a-8396-03624226b0e0+19:16175:x1876035752792192:12345-0@lo:502:mount.lustre.0 Request processed in 204us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127470.076593:0:14763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789127470.077359:0:16175:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6820bda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:16175:1876035752792192:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789127470.077639:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1789127470.077697:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1789127470.077734:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1789127470.077810:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1789127470.077853:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1789127470.077899:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1789127470.077938:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1789127470.077974:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1789127470.079303:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1789127470.079366:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1789127470.079401:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1789127470.079449:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1789127470.079502:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1789127470.079539:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1789127470.079598:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1789127470.079632:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1789127470.079665:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1789127470.079709:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1789127470.079742:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1789127470.079774:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1789127470.081847:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1789127470.081902:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1789127470.081935:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1789127470.081981:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1789127470.082030:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1789127470.082063:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1789127470.082112:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1789127470.082161:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1789127470.082211:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1789127470.082260:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1789127470.082313:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1789127470.082346:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1789127470.082380:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1789127470.082430:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1789127470.082466:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1789127470.082515:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1789127470.082549:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1789127470.082582:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1789127470.082638:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1789127470.082675:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1789127470.082725:0:16175:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6820bda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:16175:1876035752792320:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789127470.082838:0:16175:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127470.082879:0:14761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752792320 00000100:00100000:0.0:1789127470.082886:0:14761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752792320 00000100:00100000:0.0:1789127470.082931:0:14761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789127470.082940:0:14761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b404a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:396611f1-c34a-4e5a-8396-03624226b0e0+19:16175:x1876035752792320:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789127470.083137:0:14761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b404a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:396611f1-c34a-4e5a-8396-03624226b0e0+19:16175:x1876035752792320:12345-0@lo:502:mount.lustre.0 Request processed in 197us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127470.083145:0:14761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789127470.083205:0:16175:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df79021a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789127470.083225:0:16175:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6820bda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:16175:1876035752792320:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789127470.083288:0:16175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1789127470.083297:0:16175:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1789127470.087924:0:16186:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1789127470.087940:0:16186:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8df7907f8000) 00000020:00000080:1.0:1789127470.087960:0:16186:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:1.0:1789127470.088051:0:16186:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8df791481000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789127470.088056:0:16186:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8df791481000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789127470.088059:0:16186:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8df791481000 3 00010000:00080000:1.0:1789127470.088089:0:16186:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8df78606d800@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.140@tcp at head 00010000:00010000:1.0:1789127470.092036:0:16186:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:1.0:1789127470.095415:0:16186:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1789127470.095458:0:16186:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789127470.095482:0:16186:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xeeacf7c0243016ef 00000100:00080000:1.0:1789127470.095493:0:16186:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789127470.095499:0:16186:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8df78606d800 using connection 192.168.206.140@tcp/0@lo 00000100:00100000:1.0:1789127470.095533:0:16186:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df7ae2f8000 x1876035752792448/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789127470.095561:0:16186:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789127470.095716:0:14317:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789127470.095721:0:14317:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789127470.095723:0:14317:0:(import.c:65:import_set_state_nolock()) ffff8df7bb5d1800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789127470.095727:0:14317:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 413 00000100:00080000:0.0:1789127470.095731:0:14317:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1789127470.095735:0:14317:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8df7bb5d1800 using connection 192.168.206.140@tcp/0@lo 00000100:00100000:0.0:1789127470.095747:0:14317:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df6820bcb40 x1876035752792704/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789127470.095876:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6820bd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876035752792832:0@lo:400:kworker.0 00000100:00100000:0.0:1789127470.095939:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127470.095976:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789127470.095982:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6820bda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1876035752792576:0@lo:400:kworker.0 00000100:00100000:0.0:1789127470.096023:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127470.096057:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6820bed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1876035752792960:0@lo:400:kworker.0 00000100:00100000:0.0:1789127470.096080:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127470.096114:0:14771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752792832 00000100:00100000:0.0:1789127470.096120:0:14771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752792832 00000100:00100000:0.0:1789127470.096306:0:14771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752792960 00000100:00100000:0.0:1789127470.096311:0:14771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752792960 00000100:00100000:0.0:1789127470.096344:0:14771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789127470.096353:0:14771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6820bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876035752792832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127470.096406:0:14771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6820bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876035752792832:12345-0@lo:400:kworker.0 Request processed in 54us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127470.096413:0:14771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789127470.096427:0:14771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789127470.096433:0:14771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6820bf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876035752792960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127470.096465:0:14771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6820bf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876035752792960:12345-0@lo:400:kworker.0 Request processed in 32us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127470.096471:0:14771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789127470.096488:0:15455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752792576 00000100:00100000:0.0:1789127470.096492:0:15455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752792576 00000100:00100000:0.0:1789127470.096518:0:15455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789127470.096524:0:15455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6820be580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3301:x1876035752792576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127470.096551:0:15455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6820be580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3301:x1876035752792576:12345-0@lo:400:kworker.0 Request processed in 27us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127470.096557:0:15455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1789127470.096586:0:14765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789127470.096591:0:14765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789127470.096618:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df6820bed00 x1876035752792960/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127486 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127470.096643:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6820bed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1876035752792960:0@lo:400:kworker.0 00000100:00100000:0.0:1789127470.096673:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6820bda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1876035752792576:0@lo:400:kworker.0 00010000:00080000:0.0:1789127470.096682:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df6820bd680 x1876035752792832/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127486 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127470.096690:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6820bd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876035752792832:0@lo:400:kworker.0 00000100:00100000:0.0:1789127470.097273:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae2f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3299:1876035752792448:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789127470.097313:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127470.097354:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6820bcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1876035752792704:0@lo:8:kworker.0 00000100:00100000:0.0:1789127470.097394:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127470.097423:0:15456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752792704 00000100:00100000:0.0:1789127470.097428:0:15456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752792704 00000100:00100000:0.0:1789127470.097449:0:15456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789127470.097454:0:15456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6820bda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3299:x1876035752792704:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1789127470.097497:0:15456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6820bda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3299:x1876035752792704:12345-0@lo:8:kworker.0 Request processed in 41us (102us total) trans 0 rc -11/-11 00000100:00100000:0.0:1789127470.097504:0:15456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789127470.097538:0:3299:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789127470.097544:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8df7bb5d1800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789127470.097548:0:3299:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1789127470.097552:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6820bcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1876035752792704:0@lo:8:kworker.0 00000100:00100000:1.0:1789127470.099255:0:14771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752792448 00000100:00100000:1.0:1789127470.099268:0:14771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752792448 00000100:00100000:1.0:1789127470.099315:0:14771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789127470.099327:0:14771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6820bd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3299:x1876035752792448:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789127470.099355:0:14771:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 416 last 0 00000020:00000080:1.0:1789127470.099394:0:14771:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xeeacf7c0243016f6 00000004:00100000:1.0:1789127470.099411:0:14771:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789127470.099444:0:14771:0:(import.c:65:import_set_state_nolock()) ffff8df7833f5000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789127470.099518:0:14771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6820bd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876035752792448:12345-0@lo:38:llog_process_th.0 Request processed in 190us (2203us total) trans 0 rc 0/0 00010000:00080000:0.0:1789127470.103707:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df7ae2f8000 x1876035752792448/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789127480 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127470.103723:0:3299:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789127470.103747:0:3299:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1789127470.103755:0:3299:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789127470.103760:0:3299:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789127470.103764:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8df78606d800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789127470.103771:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae2f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3299:1876035752792448:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789127470.106816:0:14771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000040:00080000:1.0:1789127470.107944:0:16186:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:3.0:1789127470.108063:0:16175:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1789127470.108099:0:16175:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789127470.108116:0:16175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df7ae729200/0xeeacf7c0243016da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c0243016e1 expref: -99 pid: 16175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127470.108218:0:16175:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff8df7ae729200/0xeeacf7c0243016da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c0243016e1 expref: -99 pid: 16175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789127470.108264:0:16175:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789127470.108267:0:16175:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789127470.108268:0:16175:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789127470.108269:0:16175:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789127470.108270:0:16175:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789127470.108271:0:16175:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789127470.108273:0:16175:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789127470.108275:0:16175:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789127470.108276:0:16175:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789127470.108279:0:16175:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1789127470.108282:0:16175:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789127470.108283:0:16175:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789127470.108284:0:16175:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789127470.108285:0:16175:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789127470.108286:0:16175:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789127470.108287:0:16175:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789127470.108288:0:16175:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789127470.108289:0:16175:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789127470.108290:0:16175:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789127470.108314:0:16175:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789127470.108333:0:16175:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae041e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:16175:1876035752793088:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789127470.108396:0:16175:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127470.108431:0:16175:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7b4c3c300 going to sleep for 11 seconds 00000100:00100000:3.0:1789127470.108454:0:14764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752793088 00000100:00100000:3.0:1789127470.108460:0:14764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752793088 00000100:00100000:3.0:1789127470.108508:0:14764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789127470.108516:0:14764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b404bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:396611f1-c34a-4e5a-8396-03624226b0e0+19:16175:x1876035752793088:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789127470.108562:0:14764:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1789127470.108575:0:14764:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1789127470.165537:0:14764:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789127470.165558:0:14764:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1789127470.165616:0:14785:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789127470.165621:0:14785:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789127470.165641:0:14785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8df7bbd97000/0xeeacf7c0243016fd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127470.165657:0:14785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df7c2051200/0xeeacf7c0243015d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c0243015c9 expref: 19 pid: 14761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127470.165666:0:14785:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8df7bbd97000/0xeeacf7c0243016fd lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127470.165723:0:14785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df7c2051200/0xeeacf7c0243015d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xeeacf7c0243015c9 expref: 19 pid: 14761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127470.165735:0:14785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df7c2051200/0xeeacf7c0243015d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xeeacf7c0243015c9 expref: 19 pid: 14761 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127470.165750:0:14785:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae2fbc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14785:1876035752793216:0@lo:104: 00000100:00100000:1.0:1789127470.165855:0:14785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127470.165895:0:14785:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7b46be600 going to sleep for 11 seconds 00000100:00100000:3.0:1789127470.165951:0:14752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752793216 00000100:00100000:3.0:1789127470.165958:0:14752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752793216 00000100:00100000:3.0:1789127470.166010:0:14752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789127470.166019:0:14752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae2f9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:396611f1-c34a-4e5a-8396-03624226b0e0+3:14785:x1876035752793216:12345-0@lo:104: 00010000:00010000:3.0:1789127470.166032:0:14752:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.140@tcp lock: ffff8df7aeab7c00/0xeeacf7c0243015c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xeeacf7c0243015d0 expref: -99 pid: 14767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127470.166085:0:14752:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789127470.166091:0:14752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae2f9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:396611f1-c34a-4e5a-8396-03624226b0e0+3:14785:x1876035752793216:12345-0@lo:104: Request processed in 74us (236us total) trans 0 rc 0/0 00010000:00010000:0.0:1789127470.166094:0:14758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1789127470.166097:0:14752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1789127470.166101:0:14758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.140@tcp lock: ffff8df7aeab7c00/0xeeacf7c0243015c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xeeacf7c0243015d0 expref: -99 pid: 14767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127470.166108:0:14758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7aeab7c00 already unused, calling callback (ffffffffc1da1c20) 10000000:00010000:0.0:1789127470.166111:0:14758:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.140@tcp lock: ffff8df7aeab7c00/0xeeacf7c0243015c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xeeacf7c0243015d0 expref: -99 pid: 14767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127470.166120:0:14758:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: ffff8df7aeab7c00/0xeeacf7c0243015c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xeeacf7c0243015d0 expref: -99 pid: 14767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789127470.166127:0:14758:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: ffff8df7aeab7c00/0xeeacf7c0243015c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xeeacf7c0243015d0 expref: -99 pid: 14767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127470.166132:0:14758:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789127470.166164:0:14758:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.140@tcp lock: ffff8df7aeab7c00/0xeeacf7c0243015c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c0243015d0 expref: -99 pid: 14767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127470.166171:0:14758:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789127470.166198:0:14758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.140@tcp lock: ffff8df7aeab7c00/0xeeacf7c0243015c9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c0243015d0 expref: -99 pid: 14767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127470.166205:0:14758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: ffff8df7aeab7c00/0xeeacf7c0243015c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c0243015d0 expref: -99 pid: 14767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127470.166252:0:14758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127470.166278:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6820bcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:396611f1-c34a-4e5a-8396-03624226b0e0:3303:1876035752793344:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789127470.166309:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127470.166347:0:14785:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae2fbc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14785:1876035752793216:0@lo:104: 00000100:00100000:0.0:1789127470.166347:0:14756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752793344 00000100:00100000:0.0:1789127470.166350:0:14756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752793344 00010000:00010000:0.0:1789127470.166366:0:14756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df7c2051200/0xeeacf7c0243015d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xeeacf7c0243015c9 expref: 20 pid: 14761 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127470.166367:0:14785:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8df7bbd97000/0xeeacf7c0243016fd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127470.166388:0:14756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789127470.166394:0:14756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6820bed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:396611f1-c34a-4e5a-8396-03624226b0e0+20:3303:x1876035752793344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789127470.166405:0:14756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789127470.166410:0:14756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df7c2051200/0xeeacf7c0243015d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xeeacf7c0243015c9 expref: 20 pid: 14761 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127470.166419:0:14756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df7c2051200/0xeeacf7c0243015d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xeeacf7c0243015c9 expref: 20 pid: 14761 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127470.166433:0:14756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df7c2051200/0xeeacf7c0243015d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xeeacf7c0243015c9 expref: 20 pid: 14761 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127470.166445:0:14756:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8df7bbd97000/0xeeacf7c0243016fd lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127470.166452:0:14756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df7bbd97000/0xeeacf7c0243016fd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789127470.166462:0:14756:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009484180s 00010000:00010000:0.0:1789127470.166466:0:14756:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df7bbd97000/0xeeacf7c0243016fd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127470.166479:0:14756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df7bbd97000/0xeeacf7c0243016fd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127470.166485:0:14756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8df7bbd97000/0xeeacf7c0243016fd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127470.166491:0:14756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8df7bbd97000/0xeeacf7c0243016fd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127470.166497:0:14756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd97000 already unused, calling callback (ffffffffc17a4550) 00010000:00010000:0.0:1789127470.166501:0:14756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8df7bbd97000/0xeeacf7c0243016fd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127470.166508:0:14756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8df7bbd97000/0xeeacf7c0243016fd lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127470.166529:0:14756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8df7bbd97000/0xeeacf7c0243016fd lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127470.166539:0:14756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789127470.166573:0:14756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6820bed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:396611f1-c34a-4e5a-8396-03624226b0e0+19:3303:x1876035752793344:12345-0@lo:103:ldlm_bl.0 Request processed in 180us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127470.166580:0:14756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1789127470.166598:0:14758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127470.166601:0:14758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127470.167005:0:14785:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8df7bbd97000/0xeeacf7c0243016fd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127470.167015:0:14785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8df7bbd97000/0xeeacf7c0243016fd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127470.167020:0:14785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df7bbd97000/0xeeacf7c0243016fd lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127470.167084:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6820bcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:396611f1-c34a-4e5a-8396-03624226b0e0:3303:1876035752793344:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789127470.178601:0:14764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b404bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:396611f1-c34a-4e5a-8396-03624226b0e0+18:16175:x1876035752793088:12345-0@lo:253:mount.lustre.0 Request processed in 70077us (70196us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127470.178616:0:14764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789127470.178716:0:16175:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae041e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:396611f1-c34a-4e5a-8396-03624226b0e0:16175:1876035752793088:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789127470.178731:0:16175:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1789127470.178734:0:16175:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789127470.178736:0:16175:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789127470.178748:0:16175:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789127470.178749:0:16175:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789127470.178751:0:16175:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789127470.178752:0:16175:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789127470.178753:0:16175:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789127470.178755:0:16175:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789127470.178756:0:16175:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789127470.178770:0:16175:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1789127470.186038:0:16175:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1789127470.186216:0:16175:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1789127470.186364:0:16175:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1789127470.186503:0:16175:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1789127470.189047:0:16175:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x8:0x0] (8/8/4) registered 00080000:10000000:0.0:1789127470.189358:0:16175:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1789127470.197671:0:16175:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1789127470.335824:0:16175:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1789127470.335833:0:16175:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1789127470.335863:0:16175:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789127470.335920:0:16175:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.140@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789127470.335932:0:16175:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1789127470.335957:0:16175:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1789127470.836056:0:16036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789127471.737298:0:6714:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1789127471.737351:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00010000:00010000:3.0:1789127471.873869:0:14757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789127472.053273:0:14767:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789127472.053280:0:14767:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8df7bfc78000 from 8 10000000:01000000:3.0:1789127472.053285:0:14767:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789127472.053330:0:14767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df7c2050e00/0xeeacf7c024301704 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127472.053342:0:14767:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff8df7c2050e00/0xeeacf7c024301704 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127472.053367:0:14767:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff8df7c2050e00/0xeeacf7c024301704 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127472.053390:0:14767:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae042580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:396611f1-c34a-4e5a-8396-03624226b0e0:14767:1876035752793472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789127472.053453:0:14767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127472.053497:0:14767:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df790668900 going to sleep for 11 seconds 00000100:00100000:0.0:1789127472.053598:0:14763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752793472 00000100:00100000:0.0:1789127472.053605:0:14763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752793472 00000100:00100000:0.0:1789127472.053646:0:14763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789127472.053655:0:14763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b404a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:396611f1-c34a-4e5a-8396-03624226b0e0+18:14767:x1876035752793472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789127472.053668:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127472.053681:0:14763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df7ae728000/0xeeacf7c02430170b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xeeacf7c024301704 expref: -99 pid: 14763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127472.053702:0:14763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df7ae728000/0xeeacf7c02430170b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xeeacf7c024301704 expref: 19 pid: 14763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127472.053711:0:14763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df7ae728000/0xeeacf7c02430170b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c024301704 expref: 19 pid: 14763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127472.053719:0:14763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7ae728000, rc 0) 00000100:00100000:0.0:1789127472.053766:0:14763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b404a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:396611f1-c34a-4e5a-8396-03624226b0e0+19:14767:x1876035752793472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127472.053781:0:14763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789127472.053919:0:14767:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae042580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:396611f1-c34a-4e5a-8396-03624226b0e0:14767:1876035752793472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789127472.053932:0:14767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff8df7c2050e00/0xeeacf7c024301704 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c02430170b expref: -99 pid: 14767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127472.053940:0:14767:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff8df7c2050e00/0xeeacf7c024301704 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xeeacf7c02430170b expref: -99 pid: 14767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127472.053985:0:14767:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae042580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:396611f1-c34a-4e5a-8396-03624226b0e0:14767:1876035752793600:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789127472.054015:0:14767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127472.054043:0:14767:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df790668900 going to sleep for 11 seconds 00000100:00100000:0.0:1789127472.054150:0:14764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752793600 00000100:00100000:0.0:1789127472.054155:0:14764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752793600 00000100:00100000:0.0:1789127472.054194:0:14764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789127472.054202:0:14764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b404b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:396611f1-c34a-4e5a-8396-03624226b0e0+19:14767:x1876035752793600:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789127472.054215:0:14764:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789127472.054231:0:14764:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789127472.054234:0:14764:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1789127472.054317:0:14764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b404b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:396611f1-c34a-4e5a-8396-03624226b0e0+19:14767:x1876035752793600:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 116us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127472.054323:0:14764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789127472.054467:0:14767:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae042580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:396611f1-c34a-4e5a-8396-03624226b0e0:14767:1876035752793600:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789127472.054518:0:14767:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789127472.054525:0:14767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df7c2050e00/0xeeacf7c024301704 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c02430170b expref: -99 pid: 14767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127472.054532:0:14767:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff8df7c2050e00/0xeeacf7c024301704 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c02430170b expref: -99 pid: 14767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127472.125928:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae042580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1876035752793728:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789127472.125992:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127472.127741:0:15458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752793728 00000100:00100000:0.0:1789127472.127752:0:15458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752793728 00000100:00100000:0.0:1789127472.127829:0:15458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789127472.127838:0:15458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae2fbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876035752793728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789127472.127872:0:15458:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1789127472.129345:0:14765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789127472.135214:0:15458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae2fbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876035752793728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 7369us (9213us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127472.135228:0:15458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789127472.147866:0:3300:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1789127472.147901:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae042580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1876035752793728:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789127472.887250:0:14758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127473.907033:0:16036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789127474.358361:0:14801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789127474.934881:0:14757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789127475.187049:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789127475.187055:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789127475.187059:0:8:0:(import.c:65:import_set_state_nolock()) ffff8df7bb5d1800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789127475.187070:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8df7bb5d1800 using connection 192.168.206.140@tcp/0@lo 00000100:00100000:1.0:1789127475.187093:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df7ae2f92c0 x1876035752794112/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789127475.187171:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae2f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1876035752794368:0@lo:400:kworker.0 00000100:00100000:1.0:1789127475.187234:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127475.187286:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789127475.187293:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae2fb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:396611f1-c34a-4e5a-8396-03624226b0e0:3300:1876035752793856:0@lo:400:kworker.0 00000100:00100000:1.0:1789127475.187322:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127475.187343:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae2f8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1876035752794496:0@lo:400:kworker.0 00000100:00100000:1.0:1789127475.187368:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127475.187399:0:14769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752794368 00000100:00100000:1.0:1789127475.187406:0:14769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752794368 00000100:00100000:1.0:1789127475.187464:0:14769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752794496 00000100:00100000:1.0:1789127475.187467:0:14769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752794496 00000100:00100000:1.0:1789127475.187491:0:14769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789127475.187498:0:14769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae2f8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876035752794368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127475.187544:0:14769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae2f8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876035752794368:12345-0@lo:400:kworker.0 Request processed in 46us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127475.187559:0:14769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789127475.187574:0:14769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789127475.187581:0:14769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae2f9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876035752794496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127475.187610:0:14769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae2f9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876035752794496:12345-0@lo:400:kworker.0 Request processed in 30us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127475.187616:0:14769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789127475.187635:0:14761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752793856 00000100:00100000:1.0:1789127475.187640:0:14761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752793856 00000100:00100000:1.0:1789127475.187663:0:14761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789127475.187669:0:14761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b4048450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:396611f1-c34a-4e5a-8396-03624226b0e0+19:3300:x1876035752793856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127475.187697:0:14761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b4048450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:396611f1-c34a-4e5a-8396-03624226b0e0+19:3300:x1876035752793856:12345-0@lo:400:kworker.0 Request processed in 28us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127475.187703:0:14761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789127475.187746:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae2fb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:396611f1-c34a-4e5a-8396-03624226b0e0:3300:1876035752793856:0@lo:400:kworker.0 00010000:00080000:1.0:1789127475.187757:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df7ae2f8b40 x1876035752794496/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127491 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127475.187768:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae2f8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1876035752794496:0@lo:400:kworker.0 00010000:00080000:1.0:1789127475.187776:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df7ae2f8000 x1876035752794368/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127491 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127475.187783:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae2f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1876035752794368:0@lo:400:kworker.0 00000100:00100000:3.0:1789127475.188038:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae2f83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876035752794240:0@lo:400:kworker.0 00000100:00100000:3.0:1789127475.188068:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127475.188102:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789127475.188108:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae2f9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1876035752793984:0@lo:400:kworker.0 00000100:00100000:3.0:1789127475.188131:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789127475.188174:0:14765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789127475.188195:0:15457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752793984 00000100:00100000:3.0:1789127475.188199:0:15457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752793984 00000100:00100000:3.0:1789127475.188230:0:15457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789127475.188237:0:15457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae042d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1876035752793984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127475.188272:0:15457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae042d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1876035752793984:12345-0@lo:400:kworker.0 Request processed in 35us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127475.188278:0:15457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1789127475.188296:0:14765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789127475.188312:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae2f9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1876035752793984:0@lo:400:kworker.0 00000100:00100000:3.0:1789127475.188327:0:14769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752794240 00000100:00100000:3.0:1789127475.188331:0:14769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752794240 00000100:00100000:3.0:1789127475.188353:0:14769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789127475.188359:0:14769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae040b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876035752794240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127475.188390:0:14769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae040b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876035752794240:12345-0@lo:400:kworker.0 Request processed in 31us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127475.188396:0:14769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1789127475.188523:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df7ae2f83c0 x1876035752794240/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127491 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127475.188532:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae2f83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876035752794240:0@lo:400:kworker.0 00000100:00100000:0.0:1789127475.188623:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae2f92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1876035752794112:0@lo:8:kworker.0 00000100:00100000:0.0:1789127475.188654:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127475.188812:0:15455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752794112 00000100:00100000:3.0:1789127475.188817:0:15455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752794112 00000100:00100000:3.0:1789127475.188838:0:15455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789127475.188842:0:15455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6820bcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3299:x1876035752794112:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1789127475.188865:0:15455:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 421 last 0 00000020:00000080:3.0:1789127475.188894:0:15455:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xeeacf7c024301712 00002000:00100000:3.0:1789127475.188907:0:15455:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8df788891800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113987 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1789127475.188911:0:15455:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1789127475.188913:0:15455:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789127475.190375:0:15455:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789127475.190470:0:15455:0:(import.c:65:import_set_state_nolock()) ffff8df788897000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789127475.190559:0:15455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6820bcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3299:x1876035752794112:12345-0@lo:8:kworker.0 Request processed in 1714us (1902us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127475.190568:0:15455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1789127475.192504:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df7ae2f92c0 x1876035752794112/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789127500 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789127475.192523:0:3299:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1789127475.192532:0:3299:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789127475.192537:0:3299:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1789127475.192540:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8df7bb5d1800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789127475.192553:0:3299:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789127475.192559:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae2f92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1876035752794112:0@lo:8:kworker.0 00000004:00080000:2.0:1789127475.192589:0:14793:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789127475.192833:0:14794:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:0.0:1789127475.192856:0:14794:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6820bc780 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14794:1876035752794752:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1789127475.192912:0:14794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127475.192938:0:14794:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df78efaf0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789127475.192952:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6820bd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752794624:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789127475.192988:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127475.193024:0:15456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752794752 00000100:00100000:0.0:1789127475.193030:0:15456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752794752 00000100:00100000:0.0:1789127475.193076:0:15456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789127475.193085:0:15456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6820bde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14794:x1876035752794752:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1789127475.194033:0:14793:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 421350242573ns, next at 0ns, rc = 0 00000100:00080000:2.0:1789127475.195883:0:14765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789127475.195907:0:15459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752794624 00000100:00100000:2.0:1789127475.195916:0:15459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752794624 00000100:00100000:2.0:1789127475.195961:0:15459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789127475.195971:0:15459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6820bcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3302:x1876035752794624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789127475.196001:0:15459:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789127475.196075:0:15459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6820bcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3302:x1876035752794624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (3085us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127475.197510:0:15459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789127475.199334:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df6820bd2c0 x1876035752794624/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127491 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127475.199359:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6820bd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752794624:0@lo:13:osp-pre-1-0.0 00002000:00080000:0.0:1789127475.206212:0:15456:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1789127475.206222:0:15456:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:0.0:1789127475.206228:0:15456:0:(ofd_dev.c:1505:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00002000:00010000:0.0:1789127475.222982:0:15456:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789127475.222994:0:15456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a7963f3/0xeeacf7c024301719 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127475.223009:0:15456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=421s v=(0 0) 00010000:00010000:0.0:1789127475.223013:0:15456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789127475.223020:0:15456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003a7963f3/0xeeacf7c024301719 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127475.223036:0:15456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003a7963f3/0xeeacf7c024301719 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127475.223045:0:15456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a7963f3/0xeeacf7c024301719 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127475.223052:0:15456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003a7963f3/0xeeacf7c024301719 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127475.223069:0:15456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789127475.223087:0:14758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789127475.223092:0:14758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003a7963f3/0xeeacf7c024301719 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127475.224646:0:14758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7ae729e00 already unused, calling callback (ffffffffc17a4550) 00010000:00010000:0.0:1789127475.225098:0:14758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003a7963f3/0xeeacf7c024301719 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127475.225115:0:14758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003a7963f3/0xeeacf7c024301719 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127475.225236:0:14758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003a7963f3/0xeeacf7c024301719 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127475.225245:0:14758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003a7963f3/0xeeacf7c024301719 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127475.225346:0:14758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127475.225349:0:14758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127475.225351:0:14758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789127475.226364:0:15456:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789127475.226372:0:15456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000acbca3e3/0xeeacf7c024301720 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127475.226385:0:15456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=421s v=(0 0) 00010000:00010000:0.0:1789127475.226390:0:15456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789127475.226395:0:15456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000acbca3e3/0xeeacf7c024301720 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127475.226418:0:15456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000acbca3e3/0xeeacf7c024301720 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127475.226428:0:15456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000acbca3e3/0xeeacf7c024301720 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127475.226436:0:15456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000acbca3e3/0xeeacf7c024301720 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127475.226534:0:15456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789127475.227078:0:15456:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789127475.227084:0:15456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d049aa09/0xeeacf7c024301727 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127475.227093:0:15456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=421s v=(0 0) 00010000:00010000:0.0:1789127475.227097:0:15456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789127475.227102:0:15456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d049aa09/0xeeacf7c024301727 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127475.227111:0:15456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d049aa09/0xeeacf7c024301727 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127475.227119:0:15456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d049aa09/0xeeacf7c024301727 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127475.227157:0:15456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d049aa09/0xeeacf7c024301727 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.227492:0:16036:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789127475.227500:0:16036:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000acbca3e3/0xeeacf7c024301720 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.227509:0:16036:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7ae729400 already unused, calling callback (ffffffffc17a4550) 00010000:00010000:3.0:1789127475.227513:0:16036:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000acbca3e3/0xeeacf7c024301720 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.227522:0:16036:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000acbca3e3/0xeeacf7c024301720 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.227542:0:16036:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000acbca3e3/0xeeacf7c024301720 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.227555:0:16036:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000acbca3e3/0xeeacf7c024301720 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.227572:0:16036:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789127475.227576:0:16036:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d049aa09/0xeeacf7c024301727 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.227582:0:16036:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7ae728600 already unused, calling callback (ffffffffc17a4550) 00010000:00010000:3.0:1789127475.227585:0:16036:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d049aa09/0xeeacf7c024301727 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.227593:0:16036:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d049aa09/0xeeacf7c024301727 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.227602:0:16036:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d049aa09/0xeeacf7c024301727 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.227609:0:16036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127475.227610:0:16036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127475.227612:0:16036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127475.228622:0:15456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789127475.228633:0:15456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d049aa09/0xeeacf7c024301727 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789127475.229547:0:15456:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789127475.229556:0:15456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000701e5841/0xeeacf7c02430172e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127475.229568:0:15456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=421s v=(0 0) 00010000:00010000:0.0:1789127475.229573:0:15456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789127475.229580:0:15456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000701e5841/0xeeacf7c02430172e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127475.229591:0:15456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000701e5841/0xeeacf7c02430172e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127475.229601:0:15456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000701e5841/0xeeacf7c02430172e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127475.229608:0:15456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000701e5841/0xeeacf7c02430172e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.230349:0:14757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789127475.230357:0:14757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000701e5841/0xeeacf7c02430172e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.230366:0:14757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7ae729000 already unused, calling callback (ffffffffc17a4550) 00010000:00010000:3.0:1789127475.230377:0:14757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000701e5841/0xeeacf7c02430172e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.230387:0:14757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000701e5841/0xeeacf7c02430172e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.230404:0:14757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000701e5841/0xeeacf7c02430172e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.230413:0:14757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127475.230415:0:14757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127475.230417:0:14757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127475.230501:0:15456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789127475.230507:0:15456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000701e5841/0xeeacf7c02430172e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789127475.231330:0:15456:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789127475.231338:0:15456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a7963f3/0xeeacf7c024301735 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127475.231350:0:15456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=421s v=(0 0) 00010000:00010000:0.0:1789127475.231353:0:15456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789127475.231359:0:15456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003a7963f3/0xeeacf7c024301735 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127475.231370:0:15456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003a7963f3/0xeeacf7c024301735 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127475.231379:0:15456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a7963f3/0xeeacf7c024301735 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127475.231386:0:15456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003a7963f3/0xeeacf7c024301735 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.231579:0:14758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789127475.231585:0:14758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003a7963f3/0xeeacf7c024301735 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.231593:0:14758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7ae729e00 already unused, calling callback (ffffffffc17a4550) 00010000:00010000:3.0:1789127475.231596:0:14758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003a7963f3/0xeeacf7c024301735 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.231605:0:14758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003a7963f3/0xeeacf7c024301735 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.231619:0:14758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003a7963f3/0xeeacf7c024301735 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.231628:0:14758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127475.231636:0:14758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127475.231638:0:14758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127475.231736:0:15456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789127475.231741:0:15456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003a7963f3/0xeeacf7c024301735 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.232054:0:16036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789127475.232610:0:15456:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789127475.232617:0:15456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000291a1fc5/0xeeacf7c02430173c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127475.232629:0:15456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=421s v=(0 0) 00010000:00010000:0.0:1789127475.232634:0:15456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789127475.232639:0:15456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000291a1fc5/0xeeacf7c02430173c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127475.232648:0:15456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000291a1fc5/0xeeacf7c02430173c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127475.232712:0:15456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000291a1fc5/0xeeacf7c02430173c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127475.232722:0:15456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000291a1fc5/0xeeacf7c02430173c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127475.232781:0:15456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789127475.233254:0:15456:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789127475.233332:0:15456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0b0659b/0xeeacf7c024301743 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127475.233341:0:15456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=421s v=(0 0) 00010000:00010000:0.0:1789127475.233345:0:15456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789127475.233356:0:15456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0b0659b/0xeeacf7c024301743 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127475.233366:0:15456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0b0659b/0xeeacf7c024301743 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127475.233374:0:15456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0b0659b/0xeeacf7c024301743 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127475.233380:0:15456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a0b0659b/0xeeacf7c024301743 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.233702:0:14757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789127475.233709:0:14757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000291a1fc5/0xeeacf7c02430173c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.233717:0:14757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7ae728400 already unused, calling callback (ffffffffc17a4550) 00010000:00010000:3.0:1789127475.233720:0:14757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000291a1fc5/0xeeacf7c02430173c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.233728:0:14757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000291a1fc5/0xeeacf7c02430173c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.233744:0:14757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000291a1fc5/0xeeacf7c02430173c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.233751:0:14757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000291a1fc5/0xeeacf7c02430173c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.233766:0:14757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789127475.233769:0:14757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a0b0659b/0xeeacf7c024301743 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.233776:0:14757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7ae729a00 already unused, calling callback (ffffffffc17a4550) 00010000:00010000:3.0:1789127475.233779:0:14757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0b0659b/0xeeacf7c024301743 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.233813:0:14757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0b0659b/0xeeacf7c024301743 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.233824:0:14757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a0b0659b/0xeeacf7c024301743 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.233833:0:14757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127475.233834:0:14757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127475.233836:0:14757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127475.237268:0:15456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789127475.237281:0:15456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0b0659b/0xeeacf7c024301743 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789127475.237959:0:15456:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789127475.237967:0:15456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea982a7c/0xeeacf7c02430174a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127475.237980:0:15456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=421s v=(0 0) 00010000:00010000:0.0:1789127475.237984:0:15456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789127475.237990:0:15456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea982a7c/0xeeacf7c02430174a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127475.238003:0:15456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea982a7c/0xeeacf7c02430174a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127475.238024:0:15456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea982a7c/0xeeacf7c02430174a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127475.238032:0:15456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ea982a7c/0xeeacf7c02430174a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127475.242376:0:15456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789127475.242401:0:16036:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789127475.242409:0:16036:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ea982a7c/0xeeacf7c02430174a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127475.242424:0:16036:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7ae729800 already unused, calling callback (ffffffffc17a4550) 00010000:00010000:0.0:1789127475.242429:0:16036:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea982a7c/0xeeacf7c02430174a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127475.242440:0:16036:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea982a7c/0xeeacf7c02430174a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127475.242461:0:16036:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ea982a7c/0xeeacf7c02430174a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127475.242470:0:16036:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea982a7c/0xeeacf7c02430174a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127475.242489:0:16036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127475.242498:0:16036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127475.242500:0:16036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127475.244985:0:14758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789127475.247713:0:15456:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789127475.247727:0:15456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000701e5841/0xeeacf7c024301751 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127475.247743:0:15456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=421s v=(0 0) 00010000:00010000:0.0:1789127475.247747:0:15456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789127475.247753:0:15456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000701e5841/0xeeacf7c024301751 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127475.247767:0:15456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000701e5841/0xeeacf7c024301751 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127475.247776:0:15456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000701e5841/0xeeacf7c024301751 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127475.247783:0:15456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000701e5841/0xeeacf7c024301751 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127475.247836:0:15456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1789127475.248385:0:5852:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:3.0:1789127475.248552:0:14757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789127475.248560:0:14757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000701e5841/0xeeacf7c024301751 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.248570:0:14757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7ae729000 already unused, calling callback (ffffffffc17a4550) 00010000:00010000:3.0:1789127475.248575:0:14757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000701e5841/0xeeacf7c024301751 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.248585:0:14757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000701e5841/0xeeacf7c024301751 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.248602:0:14757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000701e5841/0xeeacf7c024301751 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.248609:0:14757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000701e5841/0xeeacf7c024301751 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.248642:0:14757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127475.248644:0:14757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127475.248645:0:14757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789127475.255688:0:15456:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789127475.255701:0:15456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea982a7c/0xeeacf7c024301758 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127475.255718:0:15456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=421s v=(0 0) 00010000:00010000:0.0:1789127475.255722:0:15456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789127475.255728:0:15456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea982a7c/0xeeacf7c024301758 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127475.255747:0:15456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea982a7c/0xeeacf7c024301758 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127475.255757:0:15456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea982a7c/0xeeacf7c024301758 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127475.255764:0:15456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ea982a7c/0xeeacf7c024301758 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127475.255810:0:15456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789127475.256003:0:14758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789127475.256010:0:14758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ea982a7c/0xeeacf7c024301758 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.256019:0:14758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7ae729800 already unused, calling callback (ffffffffc17a4550) 00010000:00010000:3.0:1789127475.256024:0:14758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea982a7c/0xeeacf7c024301758 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.256033:0:14758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea982a7c/0xeeacf7c024301758 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.256051:0:14758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ea982a7c/0xeeacf7c024301758 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.256058:0:14758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea982a7c/0xeeacf7c024301758 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.256077:0:14758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127475.256079:0:14758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127475.256081:0:14758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789127475.256773:0:15456:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789127475.256780:0:15456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0b0659b/0xeeacf7c02430175f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127475.258255:0:15456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=421s v=(0 0) 00010000:00010000:0.0:1789127475.259022:0:15456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789127475.259031:0:15456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0b0659b/0xeeacf7c02430175f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127475.259050:0:15456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0b0659b/0xeeacf7c02430175f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127475.259062:0:15456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0b0659b/0xeeacf7c02430175f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127475.259081:0:15456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a0b0659b/0xeeacf7c02430175f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.261081:0:15456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789127475.261845:0:15456:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789127475.262386:0:16036:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789127475.262394:0:16036:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a0b0659b/0xeeacf7c02430175f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127475.262407:0:16036:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7ae729a00 already unused, calling callback (ffffffffc17a4550) 00010000:00010000:0.0:1789127475.262412:0:16036:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0b0659b/0xeeacf7c02430175f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127475.262423:0:16036:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0b0659b/0xeeacf7c02430175f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127475.262441:0:16036:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a0b0659b/0xeeacf7c02430175f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127475.262449:0:16036:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0b0659b/0xeeacf7c02430175f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127475.262466:0:16036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127475.262468:0:16036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127475.262470:0:16036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127475.263614:0:15456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6beff8e/0xeeacf7c024301766 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.263632:0:15456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=421s v=(0 0) 00010000:00010000:1.0:1789127475.263637:0:15456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789127475.263644:0:15456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6beff8e/0xeeacf7c024301766 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.263660:0:15456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e6beff8e/0xeeacf7c024301766 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.263672:0:15456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6beff8e/0xeeacf7c024301766 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.263680:0:15456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e6beff8e/0xeeacf7c024301766 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.263705:0:15456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789127475.264979:0:14757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789127475.264990:0:14757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e6beff8e/0xeeacf7c024301766 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.265015:0:14757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd96a00 already unused, calling callback (ffffffffc17a4550) 00010000:00010000:3.0:1789127475.265019:0:14757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6beff8e/0xeeacf7c024301766 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.265029:0:14757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6beff8e/0xeeacf7c024301766 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.265048:0:14757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e6beff8e/0xeeacf7c024301766 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.265055:0:14757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e6beff8e/0xeeacf7c024301766 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.265076:0:14757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127475.265078:0:14757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127475.265080:0:14757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789127475.266757:0:15456:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789127475.266768:0:15456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd938015/0xeeacf7c02430176d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.266784:0:15456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=421s v=(0 0) 00010000:00010000:1.0:1789127475.266821:0:15456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789127475.266835:0:15456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bd938015/0xeeacf7c02430176d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.266850:0:15456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bd938015/0xeeacf7c02430176d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.266860:0:15456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd938015/0xeeacf7c02430176d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.266869:0:15456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bd938015/0xeeacf7c02430176d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.268279:0:15456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789127475.268890:0:15456:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789127475.268898:0:15456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f45d5e6/0xeeacf7c024301774 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.268913:0:15456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=421s v=(0 0) 00010000:00010000:1.0:1789127475.268917:0:15456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789127475.268924:0:15456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f45d5e6/0xeeacf7c024301774 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.268937:0:15456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000f45d5e6/0xeeacf7c024301774 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.268945:0:15456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f45d5e6/0xeeacf7c024301774 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.268965:0:15456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000f45d5e6/0xeeacf7c024301774 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127475.270706:0:14758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789127475.270719:0:14758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bd938015/0xeeacf7c02430176d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127475.270732:0:14758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd97e00 already unused, calling callback (ffffffffc17a4550) 00010000:00010000:2.0:1789127475.270737:0:14758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd938015/0xeeacf7c02430176d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127475.270747:0:14758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd938015/0xeeacf7c02430176d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127475.270771:0:14758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bd938015/0xeeacf7c02430176d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127475.270779:0:14758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bd938015/0xeeacf7c02430176d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127475.270820:0:14758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789127475.270824:0:14758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000f45d5e6/0xeeacf7c024301774 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127475.270831:0:14758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd96000 already unused, calling callback (ffffffffc17a4550) 00010000:00010000:2.0:1789127475.270834:0:14758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000f45d5e6/0xeeacf7c024301774 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127475.270853:0:14758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000f45d5e6/0xeeacf7c024301774 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127475.270865:0:14758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000f45d5e6/0xeeacf7c024301774 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127475.270873:0:14758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127475.270885:0:14758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127475.270887:0:14758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127475.274719:0:15456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789127475.274734:0:15456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000f45d5e6/0xeeacf7c024301774 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789127475.275396:0:15456:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789127475.275404:0:15456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021aea5c8/0xeeacf7c02430177b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.275607:0:15456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=421s v=(0 0) 00010000:00010000:1.0:1789127475.275611:0:15456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789127475.275618:0:15456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021aea5c8/0xeeacf7c02430177b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.275633:0:15456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000021aea5c8/0xeeacf7c02430177b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.275643:0:15456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021aea5c8/0xeeacf7c02430177b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.275651:0:15456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000021aea5c8/0xeeacf7c02430177b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.278683:0:16036:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789127475.278698:0:16036:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000021aea5c8/0xeeacf7c02430177b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.278712:0:16036:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd97000 already unused, calling callback (ffffffffc17a4550) 00010000:00010000:3.0:1789127475.278717:0:16036:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000021aea5c8/0xeeacf7c02430177b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.278727:0:16036:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000021aea5c8/0xeeacf7c02430177b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.278763:0:16036:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000021aea5c8/0xeeacf7c02430177b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127475.278867:0:16036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127475.278870:0:16036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127475.278872:0:16036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127475.278933:0:15456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789127475.278941:0:15456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000021aea5c8/0xeeacf7c02430177b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789127475.279703:0:15456:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789127475.279711:0:15456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039d1d77c/0xeeacf7c024301782 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.279725:0:15456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=421s v=(0 0) 00010000:00010000:1.0:1789127475.279729:0:15456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789127475.279736:0:15456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039d1d77c/0xeeacf7c024301782 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.279749:0:15456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000039d1d77c/0xeeacf7c024301782 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.279758:0:15456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039d1d77c/0xeeacf7c024301782 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.279765:0:15456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000039d1d77c/0xeeacf7c024301782 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.279938:0:15456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789127475.280367:0:15456:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789127475.280373:0:15456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e558dd3e/0xeeacf7c024301789 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.280389:0:15456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=421s v=(0 0) 00010000:00010000:1.0:1789127475.280392:0:15456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789127475.280397:0:15456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e558dd3e/0xeeacf7c024301789 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.280419:0:15456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e558dd3e/0xeeacf7c024301789 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.280429:0:15456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e558dd3e/0xeeacf7c024301789 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.280437:0:15456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e558dd3e/0xeeacf7c024301789 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127475.281273:0:14758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789127475.281283:0:14758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000039d1d77c/0xeeacf7c024301782 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127475.281293:0:14758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd96600 already unused, calling callback (ffffffffc17a4550) 00010000:00010000:2.0:1789127475.281298:0:14758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000039d1d77c/0xeeacf7c024301782 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127475.281308:0:14758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000039d1d77c/0xeeacf7c024301782 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127475.281326:0:14758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000039d1d77c/0xeeacf7c024301782 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127475.281347:0:14758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000039d1d77c/0xeeacf7c024301782 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127475.281372:0:14758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789127475.281375:0:14758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e558dd3e/0xeeacf7c024301789 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127475.281382:0:14758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd96c00 already unused, calling callback (ffffffffc17a4550) 00010000:00010000:2.0:1789127475.281385:0:14758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e558dd3e/0xeeacf7c024301789 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127475.281391:0:14758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e558dd3e/0xeeacf7c024301789 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127475.281401:0:14758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e558dd3e/0xeeacf7c024301789 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127475.281478:0:14758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127475.281480:0:14758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127475.281482:0:14758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127475.281556:0:14757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127475.281637:0:15456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789127475.281644:0:15456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e558dd3e/0xeeacf7c024301789 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789127475.285868:0:15456:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789127475.285879:0:15456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a9d083a/0xeeacf7c024301790 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.285894:0:15456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=421s v=(0 0) 00010000:00010000:1.0:1789127475.285898:0:15456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789127475.285905:0:15456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a9d083a/0xeeacf7c024301790 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.285930:0:15456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a9d083a/0xeeacf7c024301790 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.285941:0:15456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a9d083a/0xeeacf7c024301790 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.285948:0:15456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009a9d083a/0xeeacf7c024301790 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127475.287534:0:16036:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789127475.287545:0:16036:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009a9d083a/0xeeacf7c024301790 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127475.287558:0:16036:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd97800 already unused, calling callback (ffffffffc17a4550) 00010000:00010000:2.0:1789127475.287569:0:16036:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009a9d083a/0xeeacf7c024301790 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127475.287579:0:16036:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009a9d083a/0xeeacf7c024301790 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127475.287599:0:16036:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009a9d083a/0xeeacf7c024301790 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127475.287630:0:16036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127475.287633:0:16036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127475.287635:0:16036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127475.287973:0:15456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789127475.287981:0:15456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a9d083a/0xeeacf7c024301790 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.288218:0:14758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789127475.288953:0:15456:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789127475.288961:0:15456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f16675ae/0xeeacf7c024301797 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.288975:0:15456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=421s v=(0 0) 00010000:00010000:1.0:1789127475.288980:0:15456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789127475.288986:0:15456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f16675ae/0xeeacf7c024301797 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.288998:0:15456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f16675ae/0xeeacf7c024301797 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.289020:0:15456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f16675ae/0xeeacf7c024301797 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.289029:0:15456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f16675ae/0xeeacf7c024301797 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.289054:0:15456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789127475.289221:0:14757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789127475.289228:0:14757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f16675ae/0xeeacf7c024301797 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.289238:0:14757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd97400 already unused, calling callback (ffffffffc17a4550) 00010000:00010000:3.0:1789127475.289242:0:14757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f16675ae/0xeeacf7c024301797 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.289251:0:14757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f16675ae/0xeeacf7c024301797 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.289266:0:14757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f16675ae/0xeeacf7c024301797 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.289273:0:14757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f16675ae/0xeeacf7c024301797 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.289292:0:14757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127475.289294:0:14757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127475.289295:0:14757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789127475.290100:0:15456:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789127475.290108:0:15456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006153314d/0xeeacf7c02430179e lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.290281:0:15456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=421s v=(0 0) 00010000:00010000:1.0:1789127475.290286:0:15456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789127475.290292:0:15456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006153314d/0xeeacf7c02430179e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.290305:0:15456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006153314d/0xeeacf7c02430179e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.290314:0:15456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006153314d/0xeeacf7c02430179e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.290322:0:15456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006153314d/0xeeacf7c02430179e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.290399:0:15456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789127475.290998:0:15456:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789127475.291005:0:15456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003385800f/0xeeacf7c0243017a5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.291014:0:15456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=421s v=(0 0) 00010000:00010000:1.0:1789127475.291018:0:15456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789127475.291022:0:15456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003385800f/0xeeacf7c0243017a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.291031:0:15456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003385800f/0xeeacf7c0243017a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.291038:0:15456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003385800f/0xeeacf7c0243017a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.291044:0:15456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003385800f/0xeeacf7c0243017a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.292235:0:16036:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789127475.292253:0:16036:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006153314d/0xeeacf7c02430179e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.292265:0:16036:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd96e00 already unused, calling callback (ffffffffc17a4550) 00010000:00010000:3.0:1789127475.292269:0:16036:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006153314d/0xeeacf7c02430179e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.292280:0:16036:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006153314d/0xeeacf7c02430179e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.292299:0:16036:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006153314d/0xeeacf7c02430179e lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.292307:0:16036:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006153314d/0xeeacf7c02430179e lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.292330:0:16036:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789127475.292334:0:16036:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003385800f/0xeeacf7c0243017a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.292341:0:16036:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd97200 already unused, calling callback (ffffffffc17a4550) 00010000:00010000:3.0:1789127475.292345:0:16036:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003385800f/0xeeacf7c0243017a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.292353:0:16036:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003385800f/0xeeacf7c0243017a5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.292374:0:16036:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003385800f/0xeeacf7c0243017a5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.292383:0:16036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127475.292384:0:16036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127475.292386:0:16036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127475.292515:0:15456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789127475.292523:0:15456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003385800f/0xeeacf7c0243017a5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789127475.293059:0:15456:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789127475.293066:0:15456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df3a4803/0xeeacf7c0243017ac lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.293083:0:15456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=421s v=(0 0) 00010000:00010000:1.0:1789127475.293087:0:15456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789127475.293094:0:15456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000df3a4803/0xeeacf7c0243017ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.293106:0:15456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000df3a4803/0xeeacf7c0243017ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.293115:0:15456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df3a4803/0xeeacf7c0243017ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.293517:0:14758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127475.293876:0:15456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000df3a4803/0xeeacf7c0243017ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.293931:0:15456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789127475.294439:0:15456:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789127475.294447:0:15456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d1ebeae/0xeeacf7c0243017b3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.294459:0:15456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=421s v=(0 0) 00010000:00010000:1.0:1789127475.294463:0:15456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789127475.294469:0:15456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d1ebeae/0xeeacf7c0243017b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.294480:0:15456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000d1ebeae/0xeeacf7c0243017b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.294500:0:15456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d1ebeae/0xeeacf7c0243017b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.294508:0:15456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000d1ebeae/0xeeacf7c0243017b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.296441:0:14757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789127475.296452:0:14757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000df3a4803/0xeeacf7c0243017ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.296466:0:14757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd97a00 already unused, calling callback (ffffffffc17a4550) 00010000:00010000:3.0:1789127475.296470:0:14757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000df3a4803/0xeeacf7c0243017ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.296479:0:14757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000df3a4803/0xeeacf7c0243017ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.296498:0:14757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000df3a4803/0xeeacf7c0243017ac lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.296505:0:14757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000df3a4803/0xeeacf7c0243017ac lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.296530:0:14757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789127475.296534:0:14757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000d1ebeae/0xeeacf7c0243017b3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.296549:0:14757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df6820ad800 already unused, calling callback (ffffffffc17a4550) 00010000:00010000:3.0:1789127475.296553:0:14757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000d1ebeae/0xeeacf7c0243017b3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.296560:0:14757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000d1ebeae/0xeeacf7c0243017b3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.296570:0:14757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000d1ebeae/0xeeacf7c0243017b3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.296579:0:14757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127475.296580:0:14757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127475.296582:0:14757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127475.296720:0:15456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789127475.296729:0:15456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d1ebeae/0xeeacf7c0243017b3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789127475.297384:0:15456:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789127475.297392:0:15456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed73ab51/0xeeacf7c0243017ba lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.297405:0:15456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=421s v=(0 0) 00010000:00010000:1.0:1789127475.297544:0:15456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789127475.297552:0:15456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ed73ab51/0xeeacf7c0243017ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.297564:0:15456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ed73ab51/0xeeacf7c0243017ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.297574:0:15456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed73ab51/0xeeacf7c0243017ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.297593:0:15456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ed73ab51/0xeeacf7c0243017ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.297749:0:16036:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789127475.297755:0:16036:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ed73ab51/0xeeacf7c0243017ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.297763:0:16036:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df6820ac400 already unused, calling callback (ffffffffc17a4550) 00010000:00010000:3.0:1789127475.297767:0:16036:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed73ab51/0xeeacf7c0243017ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.297775:0:16036:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed73ab51/0xeeacf7c0243017ba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.297839:0:16036:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ed73ab51/0xeeacf7c0243017ba lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.298109:0:15456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789127475.298228:0:15456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ed73ab51/0xeeacf7c0243017ba lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127475.298286:0:14758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127475.298291:0:16036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127475.298293:0:16036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127475.298294:0:16036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789127475.299264:0:15456:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789127475.299273:0:15456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b6a5793a/0xeeacf7c0243017c1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127475.299285:0:15456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=421s v=(0 0) 00010000:00010000:2.0:1789127475.299289:0:15456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127475.299296:0:15456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b6a5793a/0xeeacf7c0243017c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127475.299307:0:15456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b6a5793a/0xeeacf7c0243017c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127475.299329:0:15456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b6a5793a/0xeeacf7c0243017c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127475.299337:0:15456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b6a5793a/0xeeacf7c0243017c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127475.299390:0:15456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789127475.299910:0:15456:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789127475.299917:0:15456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1c5fcce/0xeeacf7c0243017c8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127475.299927:0:15456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=421s v=(0 0) 00010000:00010000:2.0:1789127475.299931:0:15456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127475.299935:0:15456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1c5fcce/0xeeacf7c0243017c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127475.299944:0:15456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d1c5fcce/0xeeacf7c0243017c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127475.299951:0:15456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1c5fcce/0xeeacf7c0243017c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127475.299958:0:15456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d1c5fcce/0xeeacf7c0243017c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.300086:0:14757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789127475.300094:0:14757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b6a5793a/0xeeacf7c0243017c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.300102:0:14757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7aeab6e00 already unused, calling callback (ffffffffc17a4550) 00010000:00010000:3.0:1789127475.300106:0:14757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6a5793a/0xeeacf7c0243017c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.300114:0:14757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6a5793a/0xeeacf7c0243017c1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127475.300204:0:15456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789127475.300217:0:14758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789127475.300222:0:14758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d1c5fcce/0xeeacf7c0243017c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127475.300229:0:14758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7aeab7200 already unused, calling callback (ffffffffc17a4550) 00010000:00010000:2.0:1789127475.300231:0:14758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1c5fcce/0xeeacf7c0243017c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127475.300239:0:14758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1c5fcce/0xeeacf7c0243017c8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127475.300256:0:14758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d1c5fcce/0xeeacf7c0243017c8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127475.300263:0:14758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d1c5fcce/0xeeacf7c0243017c8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127475.300278:0:14758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127475.300280:0:14758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127475.300281:0:14758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127475.300491:0:14757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b6a5793a/0xeeacf7c0243017c1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.300499:0:14757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b6a5793a/0xeeacf7c0243017c1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.300513:0:14757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127475.300514:0:14757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127475.300516:0:14757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789127475.300958:0:15456:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789127475.300964:0:15456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012d820e1/0xeeacf7c0243017cf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127475.300974:0:15456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=421s v=(0 0) 00010000:00010000:2.0:1789127475.300982:0:15456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127475.300989:0:15456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000012d820e1/0xeeacf7c0243017cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127475.300999:0:15456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000012d820e1/0xeeacf7c0243017cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127475.301007:0:15456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012d820e1/0xeeacf7c0243017cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127475.301014:0:15456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000012d820e1/0xeeacf7c0243017cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127475.301069:0:15456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1789127475.301348:0:15456:0:(ofd_dev.c:1532:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:2.0:1789127475.301518:0:15456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6820bde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14794:x1876035752794752:12345-0@lo:5:osp-pre-1-0.0 Request processed in 108429us (108601us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127475.301527:0:15456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789127475.303623:0:14794:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6820bc780 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14794:1876035752794752:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1789127475.303642:0:14794:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:0.0:1789127475.303699:0:14794:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6820bc780 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14794:1876035752794880:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1789127475.303755:0:14794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789127475.303768:0:16036:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789127475.303777:0:16036:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000012d820e1/0xeeacf7c0243017cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.303799:0:16036:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7aeab7c00 already unused, calling callback (ffffffffc17a4550) 00000100:00100000:0.0:1789127475.303806:0:14794:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df78efaf0c0 going to sleep for 11 seconds 00010000:00010000:3.0:1789127475.303809:0:16036:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000012d820e1/0xeeacf7c0243017cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.303820:0:16036:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000012d820e1/0xeeacf7c0243017cf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127475.303824:0:15457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752794880 00000100:00100000:0.0:1789127475.303829:0:15457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752794880 00010000:00010000:3.0:1789127475.303838:0:16036:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000012d820e1/0xeeacf7c0243017cf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.303844:0:16036:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000012d820e1/0xeeacf7c0243017cf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.303881:0:16036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127475.303883:0:16036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127475.303885:0:16036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127475.305433:0:15457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789127475.305448:0:15457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6820be940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14794:x1876035752794880:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1789127475.305499:0:15457:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:1.0:1789127475.330113:0:15457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6820be940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14794:x1876035752794880:12345-0@lo:5:osp-pre-1-0.0 Request processed in 24664us (26353us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1789127475.330140:0:15457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789127475.332962:0:14794:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6820bc780 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14794:1876035752794880:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1789127475.332980:0:14794:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000001:00080000:0.0:1789127475.825382:0:7646:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:0.0:1789127475.825641:0:7646:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1789127475.958996:0:14758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127476.983109:0:14757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127477.235157:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789127477.235178:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae042940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752795008:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789127477.235241:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127477.235466:0:15459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752795008 00000100:00100000:2.0:1789127477.235473:0:15459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752795008 00000100:00100000:2.0:1789127477.235541:0:15459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789127477.235551:0:15459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae041680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876035752795008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789127477.235581:0:15459:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789127477.235628:0:15459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae041680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876035752795008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127477.235635:0:15459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789127477.235681:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae042940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752795008:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789127477.235753:0:14765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:1.0:1789127477.816832:0:16532:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789127478.006957:0:16036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127479.027699:0:14758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127480.046663:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127480.046738:0:14763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733923072 00000100:00100000:1.0:1789127480.046750:0:14763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733923072 00000100:00100000:1.0:1789127480.046829:0:14763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 75 00000100:00100000:1.0:1789127480.046837:0:14763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b404b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2345:x1876035733923072:12345-192.168.206.40@tcp:250:mount.lustre.0 00010000:00080000:1.0:1789127480.046866:0:14763:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from 24264358-ed5d-48f3-a95a-0a1ee90442a0@192.168.206.40@tcp t0 exp 0000000000000000 cur 426 last 0 00000020:00000080:1.0:1789127480.046896:0:14763:0:(genops.c:1385:class_connect()) connect: client 24264358-ed5d-48f3-a95a-0a1ee90442a0, cookie 0xeeacf7c0243017d6 00000100:00080000:1.0:1789127480.047018:0:14763:0:(import.c:65:import_set_state_nolock()) ffff8df682adf800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789127480.047082:0:14763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b404b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24264358-ed5d-48f3-a95a-0a1ee90442a0+5:2345:x1876035733923072:12345-192.168.206.40@tcp:250:mount.lustre.0 Request processed in 244us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127480.047090:0:14763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 75 00010000:00010000:3.0:1789127480.051133:0:14757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127480.061641:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127480.061709:0:14764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733923200 00000100:00100000:2.0:1789127480.061719:0:14764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733923200 00000100:00100000:2.0:1789127480.061778:0:14764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 76 00000100:00100000:2.0:1789127480.061825:0:14764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b404ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24264358-ed5d-48f3-a95a-0a1ee90442a0+5:13936:x1876035733923200:12345-192.168.206.40@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789127480.061843:0:14764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127480.061912:0:14764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df7c2051200/0xeeacf7c0243017dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7e8b expref: -99 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127480.061945:0:14764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df7c2051200/0xeeacf7c0243017dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7e8b expref: 6 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127480.061956:0:14764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df7c2051200/0xeeacf7c0243017dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7e8b expref: 6 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127480.061981:0:14764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7c2051200, rc 0) 00000100:00100000:3.0:1789127480.062037:0:14764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b404ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24264358-ed5d-48f3-a95a-0a1ee90442a0+6:13936:x1876035733923200:12345-192.168.206.40@tcp:101:mount.lustre.0 Request processed in 251us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127480.062045:0:14764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 76 00000100:00100000:0.0:1789127480.064678:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127480.064826:0:14761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733923328 00000100:00100000:2.0:1789127480.064836:0:14761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733923328 00000100:00100000:2.0:1789127480.064941:0:14761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 77 00000100:00100000:2.0:1789127480.064951:0:14761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b4048850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24264358-ed5d-48f3-a95a-0a1ee90442a0+6:13936:x1876035733923328:12345-192.168.206.40@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789127480.065585:0:14761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b4048850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24264358-ed5d-48f3-a95a-0a1ee90442a0+6:13936:x1876035733923328:12345-192.168.206.40@tcp:501:mount.lustre.0 Request processed in 632us (912us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789127480.065595:0:14761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 77 00000100:00100000:0.0:1789127480.074356:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127480.078952:0:14764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733923456 00000100:00100000:3.0:1789127480.078964:0:14764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733923456 00000100:00100000:3.0:1789127480.079027:0:14764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 78 00000100:00100000:3.0:1789127480.079036:0:14764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae006850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24264358-ed5d-48f3-a95a-0a1ee90442a0+6:13936:x1876035733923456:12345-192.168.206.40@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789127480.079051:0:14764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127480.079075:0:14764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df7c2051600/0xeeacf7c0243017e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7e92 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127480.079312:0:14764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df7c2051600/0xeeacf7c0243017e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7e92 expref: 7 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127480.079324:0:14764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df7c2051600/0xeeacf7c0243017e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7e92 expref: 7 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127480.079333:0:14764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7c2051600, rc 0) 00000100:00100000:3.0:1789127480.079390:0:14764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae006850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24264358-ed5d-48f3-a95a-0a1ee90442a0+7:13936:x1876035733923456:12345-192.168.206.40@tcp:101:mount.lustre.0 Request processed in 355us (5044us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127480.079397:0:14764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 78 00000100:00100000:0.0:1789127480.082055:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127480.082181:0:14761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733923584 00000100:00100000:3.0:1789127480.082203:0:14761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733923584 00000100:00100000:3.0:1789127480.082257:0:14761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 79 00000100:00100000:3.0:1789127480.082266:0:14761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae007450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24264358-ed5d-48f3-a95a-0a1ee90442a0+7:13936:x1876035733923584:12345-192.168.206.40@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789127480.082540:0:14761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae007450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24264358-ed5d-48f3-a95a-0a1ee90442a0+8:13936:x1876035733923584:12345-192.168.206.40@tcp:501:mount.lustre.0 Request processed in 274us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127480.082548:0:14761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 79 00000100:00100000:0.0:1789127480.084679:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127480.084732:0:14764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733923712 00000100:00100000:3.0:1789127480.084741:0:14764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733923712 00000100:00100000:3.0:1789127480.084822:0:14764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 80 00000100:00100000:3.0:1789127480.084831:0:14764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae004c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24264358-ed5d-48f3-a95a-0a1ee90442a0+8:13936:x1876035733923712:12345-192.168.206.40@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789127480.085258:0:14764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae004c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24264358-ed5d-48f3-a95a-0a1ee90442a0+8:13936:x1876035733923712:12345-192.168.206.40@tcp:503:mount.lustre.0 Request processed in 426us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127480.085267:0:14764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 80 00000100:00100000:2.0:1789127480.088249:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127480.088673:0:14763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733923840 00000100:00100000:1.0:1789127480.088683:0:14763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733923840 00000100:00100000:1.0:1789127480.088868:0:14763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 81 00000100:00100000:1.0:1789127480.088879:0:14763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae006050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24264358-ed5d-48f3-a95a-0a1ee90442a0+8:13955:x1876035733923840:12345-192.168.206.40@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789127480.089232:0:14763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae006050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24264358-ed5d-48f3-a95a-0a1ee90442a0+8:13955:x1876035733923840:12345-192.168.206.40@tcp:502:llog_process_th.0 Request processed in 354us (990us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127480.089240:0:14763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 81 00000100:00100000:2.0:1789127480.111109:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127480.111253:0:14764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733923968 00000100:00100000:0.0:1789127480.111262:0:14764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733923968 00000100:00100000:0.0:1789127480.111326:0:14764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 82 00000100:00100000:0.0:1789127480.111335:0:14764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae006450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24264358-ed5d-48f3-a95a-0a1ee90442a0+8:13955:x1876035733923968:12345-192.168.206.40@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789127480.111698:0:14764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae006450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24264358-ed5d-48f3-a95a-0a1ee90442a0+8:13955:x1876035733923968:12345-192.168.206.40@tcp:502:llog_process_th.0 Request processed in 363us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127480.111706:0:14764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 82 00000100:00100000:0.0:1789127480.123839:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127480.124178:0:14763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733924096 00000100:00100000:1.0:1789127480.124188:0:14763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733924096 00000100:00100000:1.0:1789127480.124237:0:14763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 83 00000100:00100000:1.0:1789127480.124247:0:14763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae005c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24264358-ed5d-48f3-a95a-0a1ee90442a0+8:13936:x1876035733924096:12345-192.168.206.40@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789127480.124262:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127480.124279:0:14763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df6820aca00/0xeeacf7c0243017eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7ebc expref: -99 pid: 14763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127480.124305:0:14763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df6820aca00/0xeeacf7c0243017eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7ebc expref: 9 pid: 14763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127480.124315:0:14763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df6820aca00/0xeeacf7c0243017eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7ebc expref: 9 pid: 14763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127480.124323:0:14763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df6820aca00, rc 0) 00000100:00100000:1.0:1789127480.124387:0:14763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae005c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24264358-ed5d-48f3-a95a-0a1ee90442a0+9:13936:x1876035733924096:12345-192.168.206.40@tcp:101:mount.lustre.0 Request processed in 141us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127480.124393:0:14763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 83 00000100:00100000:2.0:1789127480.138696:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127480.140301:0:14764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733924224 00000100:00100000:1.0:1789127480.140313:0:14764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733924224 00000100:00100000:1.0:1789127480.140359:0:14764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 84 00000100:00100000:1.0:1789127480.140368:0:14764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae007c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24264358-ed5d-48f3-a95a-0a1ee90442a0+9:13936:x1876035733924224:12345-192.168.206.40@tcp:256:mount.lustre.0 20000000:01000000:1.0:1789127480.140392:0:14764:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1789127480.140419:0:14764:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789127480.140423:0:14764:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1789127480.140426:0:14764:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1789127480.140428:0:14764:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1789127480.143058:0:14764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae007c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24264358-ed5d-48f3-a95a-0a1ee90442a0+9:13936:x1876035733924224:12345-192.168.206.40@tcp:256:mount.lustre.0 Request processed in 2681us (4361us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127480.143079:0:14764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 84 00000100:00100000:3.0:1789127480.146713:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127480.146818:0:14761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733924352 00000100:00100000:1.0:1789127480.146827:0:14761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733924352 00000100:00100000:1.0:1789127480.146874:0:14761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 85 00000100:00100000:1.0:1789127480.146884:0:14761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b5235450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24264358-ed5d-48f3-a95a-0a1ee90442a0+9:13936:x1876035733924352:12345-192.168.206.40@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789127480.146899:0:14761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127480.146915:0:14761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df6820ac200/0xeeacf7c0243017f2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7ec3 expref: -99 pid: 14761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127480.146940:0:14761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df6820ac200/0xeeacf7c0243017f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7ec3 expref: 10 pid: 14761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127480.146951:0:14761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df6820ac200/0xeeacf7c0243017f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7ec3 expref: 10 pid: 14761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127480.146959:0:14761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df6820ac200, rc 0) 00000100:00100000:1.0:1789127480.147002:0:14761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b5235450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24264358-ed5d-48f3-a95a-0a1ee90442a0+10:13936:x1876035733924352:12345-192.168.206.40@tcp:101:mount.lustre.0 Request processed in 120us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127480.147009:0:14761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 85 00000100:00100000:2.0:1789127480.150885:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127480.150985:0:14764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733924480 00000100:00100000:1.0:1789127480.150993:0:14764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733924480 00000100:00100000:1.0:1789127480.151201:0:14764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 86 00000100:00100000:1.0:1789127480.151211:0:14764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b5236c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24264358-ed5d-48f3-a95a-0a1ee90442a0+10:13936:x1876035733924480:12345-192.168.206.40@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789127480.152765:0:14764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b5236c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24264358-ed5d-48f3-a95a-0a1ee90442a0+10:13936:x1876035733924480:12345-192.168.206.40@tcp:501:mount.lustre.0 Request processed in 1548us (1880us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127480.152777:0:14764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 86 00000100:00100000:0.0:1789127480.160231:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127480.160321:0:14763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733924608 00000100:00100000:3.0:1789127480.160330:0:14763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733924608 00000100:00100000:3.0:1789127480.160410:0:14763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 87 00000100:00100000:3.0:1789127480.160419:0:14763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b5236850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24264358-ed5d-48f3-a95a-0a1ee90442a0+10:13936:x1876035733924608:12345-192.168.206.40@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789127480.160776:0:14763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b5236850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24264358-ed5d-48f3-a95a-0a1ee90442a0+10:13936:x1876035733924608:12345-192.168.206.40@tcp:503:mount.lustre.0 Request processed in 356us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127480.160784:0:14763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 87 00000100:00100000:0.0:1789127480.167518:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127480.168200:0:14764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733924736 00000100:00100000:1.0:1789127480.168210:0:14764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733924736 00000100:00100000:1.0:1789127480.168263:0:14764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 88 00000100:00100000:1.0:1789127480.168272:0:14764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b5235c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24264358-ed5d-48f3-a95a-0a1ee90442a0+10:13959:x1876035733924736:12345-192.168.206.40@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789127480.168536:0:14764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b5235c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24264358-ed5d-48f3-a95a-0a1ee90442a0+10:13959:x1876035733924736:12345-192.168.206.40@tcp:502:llog_process_th.0 Request processed in 263us (1026us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127480.168544:0:14764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 88 00000100:00100000:2.0:1789127480.186785:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127480.186900:0:14763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733924864 00000100:00100000:3.0:1789127480.186909:0:14763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733924864 00000100:00100000:3.0:1789127480.186960:0:14763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 89 00000100:00100000:3.0:1789127480.186969:0:14763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b5236450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24264358-ed5d-48f3-a95a-0a1ee90442a0+10:13959:x1876035733924864:12345-192.168.206.40@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789127480.187417:0:14763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b5236450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24264358-ed5d-48f3-a95a-0a1ee90442a0+10:13959:x1876035733924864:12345-192.168.206.40@tcp:502:llog_process_th.0 Request processed in 447us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127480.187426:0:14763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 89 00000100:00100000:0.0:1789127480.209842:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127480.209927:0:14771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733924992 00000100:00100000:1.0:1789127480.209961:0:14771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733924992 00000100:00100000:1.0:1789127480.210004:0:14771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 4 00000100:00100000:1.0:1789127480.210013:0:14771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6820bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2345:x1876035733924992:12345-192.168.206.40@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789127480.210039:0:14771:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from 120b6615-98eb-47cd-be5f-d74b7a580836@192.168.206.40@tcp t0 exp 0000000000000000 cur 426 last 0 00000020:00000080:1.0:1789127480.210102:0:14771:0:(genops.c:1385:class_connect()) connect: client 120b6615-98eb-47cd-be5f-d74b7a580836, cookie 0xeeacf7c0243017f9 00000004:00100000:1.0:1789127480.210142:0:14771:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1789127480.210148:0:14771:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:1.0:1789127480.251905:0:14771:0:(import.c:65:import_set_state_nolock()) ffff8df7a0324800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789127480.251976:0:14771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6820bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:120b6615-98eb-47cd-be5f-d74b7a580836+6:2345:x1876035733924992:12345-192.168.206.40@tcp:38:mount.lustre.0 Request processed in 41962us (42143us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127480.251986:0:14771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 4 00000100:00100000:0.0:1789127480.255037:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127480.255390:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127480.255753:0:15986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733925120 00000100:00100000:1.0:1789127480.255762:0:15986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733925120 00000100:00080000:2.0:1789127480.255937:0:14765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789127480.255982:0:14770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733925248 00000100:00100000:3.0:1789127480.255986:0:14770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733925248 00000100:00100000:3.0:1789127480.256077:0:14770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 5 00000100:00100000:3.0:1789127480.256088:0:14770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df682c70780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:120b6615-98eb-47cd-be5f-d74b7a580836+7:13936:x1876035733925248:12345-192.168.206.40@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789127480.256143:0:14770:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789127480.256230:0:14770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df682c70780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:120b6615-98eb-47cd-be5f-d74b7a580836+7:13936:x1876035733925248:12345-192.168.206.40@tcp:41:mount.lustre.0 Request processed in 143us (839us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127480.256238:0:14770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 5 00000100:00100000:1.0:1789127480.256783:0:14769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 6 00000100:00100000:1.0:1789127480.256828:0:14769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6820bd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:120b6615-98eb-47cd-be5f-d74b7a580836+6:0:x1876035733925120:12345-192.168.206.40@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789127480.256845:0:14769:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789127480.256933:0:14769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6820bd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:120b6615-98eb-47cd-be5f-d74b7a580836+6:0:x1876035733925120:12345-192.168.206.40@tcp:41:mount.lustre.0 Request processed in 110us (1903us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127480.256940:0:14769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 6 00000100:00100000:2.0:1789127480.258964:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127480.259304:0:14769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733925376 00000100:00100000:1.0:1789127480.259313:0:14769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733925376 00000100:00100000:1.0:1789127480.259357:0:14769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 7 00000100:00100000:1.0:1789127480.259366:0:14769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6826a43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:120b6615-98eb-47cd-be5f-d74b7a580836+6:13936:x1876035733925376:12345-192.168.206.40@tcp:40:mount.lustre.0 00000100:00100000:1.0:1789127480.259442:0:14769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6826a43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:120b6615-98eb-47cd-be5f-d74b7a580836+6:13936:x1876035733925376:12345-192.168.206.40@tcp:40:mount.lustre.0 Request processed in 64us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127480.259451:0:14769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 7 00000100:00100000:2.0:1789127480.264559:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127480.264778:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127480.264820:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127480.264875:0:15455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733925504 00000100:00100000:1.0:1789127480.264883:0:15455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733925504 00000100:00100000:1.0:1789127480.264915:0:15455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733925632 00000100:00100000:1.0:1789127480.264918:0:15455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733925632 00000100:00100000:1.0:1789127480.264929:0:15455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 8 00000100:00100000:1.0:1789127480.264936:0:15455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6826a4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2345:x1876035733925504:12345-192.168.206.40@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789127480.264963:0:15455:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 120b6615-98eb-47cd-be5f-d74b7a580836@192.168.206.40@tcp t0 exp 0000000000000000 cur 426 last 0 00000020:00000080:1.0:1789127480.264990:0:15455:0:(genops.c:1385:class_connect()) connect: client 120b6615-98eb-47cd-be5f-d74b7a580836, cookie 0xeeacf7c024301800 00002000:00100000:1.0:1789127480.265000:0:15455:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 120b6615-98eb-47cd-be5f-d74b7a580836/ffff8df78606c800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113987 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789127480.265020:0:15455:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789127480.265307:0:15455:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789127480.265331:0:15455:0:(import.c:65:import_set_state_nolock()) ffff8df78606f000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789127480.265381:0:15455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6826a4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:120b6615-98eb-47cd-be5f-d74b7a580836+6:2345:x1876035733925504:12345-192.168.206.40@tcp:8:mount.lustre.0 Request processed in 444us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127480.265399:0:15455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 8 00000100:00100000:1.0:1789127480.265416:0:15455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 9 00000100:00100000:1.0:1789127480.265420:0:15455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6826a7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2345:x1876035733925632:12345-192.168.206.40@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789127480.265594:0:15455:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 120b6615-98eb-47cd-be5f-d74b7a580836@192.168.206.40@tcp t0 exp 0000000000000000 cur 426 last 0 00000020:00000080:1.0:1789127480.265670:0:15455:0:(genops.c:1385:class_connect()) connect: client 120b6615-98eb-47cd-be5f-d74b7a580836, cookie 0xeeacf7c024301807 00002000:00100000:1.0:1789127480.265676:0:15455:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 120b6615-98eb-47cd-be5f-d74b7a580836/ffff8df78606e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113987 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789127480.265689:0:15455:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789127480.266057:0:15455:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789127480.266699:0:15455:0:(import.c:65:import_set_state_nolock()) ffff8df78606e800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789127480.266825:0:15455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6826a7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:120b6615-98eb-47cd-be5f-d74b7a580836+6:2345:x1876035733925632:12345-192.168.206.40@tcp:8:mount.lustre.0 Request processed in 1400us (2002us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127480.266834:0:15455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 9 00000100:00100000:2.0:1789127480.270394:0:14772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733925760 00000100:00100000:2.0:1789127480.270408:0:14772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733925760 00000100:00100000:2.0:1789127480.270478:0:14772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 0 00000100:00100000:2.0:1789127480.270489:0:14772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6826a6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:120b6615-98eb-47cd-be5f-d74b7a580836+6:13936:x1876035733925760:12345-192.168.206.40@tcp:33:mount.lustre.0 00000004:00080000:0.0:1789127480.276806:0:14772:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 5951us 00000004:00200000:0.0:1789127480.288545:0:14772:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:0.0:1789127480.288723:0:14772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6826a6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:120b6615-98eb-47cd-be5f-d74b7a580836+6:13936:x1876035733925760:12345-192.168.206.40@tcp:33:mount.lustre.0 Request processed in 18231us (24166us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127480.288739:0:14772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 0 00000100:00100000:1.0:1789127480.307918:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae0430c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1876035752795136:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789127480.307981:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127480.308605:0:15459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752795136 00000100:00100000:3.0:1789127480.308619:0:15459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752795136 00000100:00080000:2.0:1789127480.308701:0:14765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789127480.308729:0:15459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789127480.308746:0:15459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae2f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876035752795136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789127480.308779:0:15459:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789127480.308821:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df682c721c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:396611f1-c34a-4e5a-8396-03624226b0e0:3301:1876035752795264:0@lo:400:kworker.0 00000100:00100000:0.0:1789127480.308941:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df682c703c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752795392:0@lo:400:kworker.0 00000100:00100000:1.0:1789127480.311903:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df682c70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1876035752795648:0@lo:400:kworker.0 00000100:00100000:3.0:1789127480.312391:0:15459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae2f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876035752795136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3647us (4405us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127480.312406:0:15459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789127480.332414:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127480.339631:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df682c71680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1876035752795776:0@lo:400:kworker.0 00000100:00100000:2.0:1789127480.339701:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127480.339781:0:15986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752795776 00000100:00100000:0.0:1789127480.339810:0:15986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752795776 00000100:00100000:0.0:1789127480.339867:0:15986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789127480.339877:0:15986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6826a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876035752795776:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789127480.339914:0:14765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789127480.339932:0:15986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6826a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876035752795776:12345-0@lo:400:kworker.0 Request processed in 56us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127480.339939:0:15986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789127480.339964:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df682c712c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876035752795520:0@lo:400:kworker.0 00000100:00100000:0.0:1789127480.340004:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127480.340047:0:14771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752795520 00000100:00100000:0.0:1789127480.340051:0:14771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752795520 00000100:00100000:0.0:1789127480.340090:0:14771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789127480.340097:0:14771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df682c72d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876035752795520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127480.340141:0:14771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df682c72d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876035752795520:12345-0@lo:400:kworker.0 Request processed in 45us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127480.340147:0:14771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1789127480.340178:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df682c712c0 x1876035752795520/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127496 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127480.340190:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df682c712c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876035752795520:0@lo:400:kworker.0 00010000:00080000:0.0:1789127480.340212:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df682c71680 x1876035752795776/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127496 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127480.340219:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df682c71680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1876035752795776:0@lo:400:kworker.0 00000100:00100000:0.0:1789127480.340245:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127480.340265:0:15457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752795392 00000100:00100000:0.0:1789127480.340267:0:15457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752795392 00000100:00100000:0.0:1789127480.340292:0:15457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789127480.340297:0:15457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df682c71680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1876035752795392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127480.340324:0:15457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df682c71680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1876035752795392:12345-0@lo:400:kworker.0 Request processed in 26us (78us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127480.340329:0:15457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1789127480.340344:0:14765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789127480.340358:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df682c703c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752795392:0@lo:400:kworker.0 00000100:00100000:2.0:1789127480.346718:0:14761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752795264 00000100:00100000:2.0:1789127480.346739:0:14761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752795264 00000100:00100000:2.0:1789127480.346846:0:14761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789127480.346862:0:14761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b5234c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:396611f1-c34a-4e5a-8396-03624226b0e0+19:3301:x1876035752795264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127480.346997:0:14761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b5234c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:396611f1-c34a-4e5a-8396-03624226b0e0+19:3301:x1876035752795264:12345-0@lo:400:kworker.0 Request processed in 139us (14588us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127480.347007:0:14761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789127480.347056:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df682c721c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:396611f1-c34a-4e5a-8396-03624226b0e0:3301:1876035752795264:0@lo:400:kworker.0 00000100:00100000:1.0:1789127480.347778:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127480.347949:0:3300:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1789127480.347984:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae0430c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1876035752795136:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789127480.349367:0:15986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752795648 00000100:00100000:2.0:1789127480.349384:0:15986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752795648 00000100:00100000:2.0:1789127480.349503:0:15986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789127480.349515:0:15986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae2f8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876035752795648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127480.349634:0:15986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae2f8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876035752795648:12345-0@lo:400:kworker.0 Request processed in 121us (1858us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127480.349643:0:15986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1789127480.349770:0:14765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789127480.360999:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df682c70000 x1876035752795648/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127496 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127480.361024:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df682c70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1876035752795648:0@lo:400:kworker.0 00000100:00100000:0.0:1789127480.580213:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127480.580307:0:14770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733925888 00000100:00100000:3.0:1789127480.580316:0:14770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733925888 00000100:00100000:3.0:1789127480.580371:0:14770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 8 00000100:00100000:3.0:1789127480.580380:0:14770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df682c70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:120b6615-98eb-47cd-be5f-d74b7a580836+6:13981:x1876035733925888:12345-192.168.206.40@tcp:101:mkdir.0 00010000:00010000:3.0:1789127480.580399:0:14770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127480.580425:0:14770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c02430180e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7eed expref: -99 pid: 14770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127480.580483:0:14770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024301815 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127480.580527:0:14770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024301815 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127480.580543:0:14770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024301815 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789127480.580733:0:14770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1789127480.580737:0:14770:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1789127480.580861:0:14770:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024301815 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127480.580888:0:14770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96600/0xeeacf7c02430180e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7eed expref: 8 pid: 14770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127480.580902:0:14770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024301815 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7eed expref: 7 pid: 14770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127480.580910:0:14770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df79f06cb00) 00010000:00010000:3.0:1789127480.580912:0:14770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789127480.580915:0:14770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7bbd97e00, rc 0) 00000100:00100000:3.0:1789127480.580971:0:14770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df682c70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:120b6615-98eb-47cd-be5f-d74b7a580836+7:13981:x1876035733925888:12345-192.168.206.40@tcp:101:mkdir.0 Request processed in 592us (767us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127480.580978:0:14770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 8 00000001:00100000:0.0:1789127480.861985:0:7646:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 120b6615-98eb-47cd-be5f-d74b7a580836 00010000:00010000:0.0:1789127481.077332:0:16036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789127481.906666:0:6714:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 120b6615-98eb-47cd-be5f-d74b7a580836 00010000:00010000:0.0:1789127482.099033:0:14758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127482.355356:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae040f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752795904:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789127482.355446:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127482.355918:0:15458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752795904 00000100:00100000:1.0:1789127482.355928:0:15458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752795904 00000100:00100000:1.0:1789127482.356000:0:15458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789127482.356011:0:15458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6826a5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876035752795904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789127482.356047:0:15458:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1789127482.356144:0:14765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789127482.362554:0:15458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6826a5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876035752795904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 6535us (7097us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127482.362684:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae040f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752795904:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789127482.363327:0:15458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789127482.967957:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127482.968060:0:15986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733926016 00000100:00100000:0.0:1789127482.968070:0:15986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733926016 00000100:00100000:0.0:1789127482.968264:0:15986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 9 00000100:00100000:0.0:1789127482.968276:0:15986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6826a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:120b6615-98eb-47cd-be5f-d74b7a580836+7:14034:x1876035733926016:12345-192.168.206.40@tcp:41:lfs.0 00000004:00000024:0.0:1789127482.968317:0:15986:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789127482.968404:0:15986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6826a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:120b6615-98eb-47cd-be5f-d74b7a580836+7:14034:x1876035733926016:12345-192.168.206.40@tcp:41:lfs.0 Request processed in 131us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127482.968413:0:15986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 9 00000100:00080000:3.0:1789127482.968470:0:14765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789127482.977483:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127482.977588:0:15459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733926144 00000100:00100000:3.0:1789127482.977598:0:15459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733926144 00000100:00100000:3.0:1789127482.977693:0:15459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 6 00000100:00100000:3.0:1789127482.977719:0:15459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6826a61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:120b6615-98eb-47cd-be5f-d74b7a580836+5:14034:x1876035733926144:12345-192.168.206.40@tcp:13:lfs.0 00002000:00000024:3.0:1789127482.977749:0:15459:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789127482.977873:0:15459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6826a61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:120b6615-98eb-47cd-be5f-d74b7a580836+5:14034:x1876035733926144:12345-192.168.206.40@tcp:13:lfs.0 Request processed in 156us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127482.977882:0:15459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 6 00000100:00080000:0.0:1789127482.978209:0:14765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789127482.988214:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127482.988847:0:15459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733926272 00000100:00100000:0.0:1789127482.988858:0:15459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733926272 00000100:00100000:0.0:1789127482.988936:0:15459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 7 00000100:00100000:0.0:1789127482.988946:0:15459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae040f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:120b6615-98eb-47cd-be5f-d74b7a580836+5:14034:x1876035733926272:12345-192.168.206.40@tcp:13:lfs.0 00002000:00000024:0.0:1789127482.988981:0:15459:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789127482.989079:0:15459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae040f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:120b6615-98eb-47cd-be5f-d74b7a580836+5:14034:x1876035733926272:12345-192.168.206.40@tcp:13:lfs.0 Request processed in 127us (867us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127482.989087:0:15459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 7 00000100:00080000:3.0:1789127482.989373:0:14765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789127483.124054:0:14757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127483.242474:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127483.242570:0:14763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733926400 00000100:00100000:3.0:1789127483.242579:0:14763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733926400 00000100:00100000:3.0:1789127483.242634:0:14763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 91 00000100:00100000:3.0:1789127483.242645:0:14763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b5237c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24264358-ed5d-48f3-a95a-0a1ee90442a0+10:14068:x1876035733926400:12345-192.168.206.40@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789127483.242671:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127483.242690:0:14763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df7bbd96600/0xeeacf7c02430181c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7ef4 expref: -99 pid: 14763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127483.242717:0:14763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df7bbd96600/0xeeacf7c02430181c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7ef4 expref: 11 pid: 14763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127483.242727:0:14763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df7bbd96600/0xeeacf7c02430181c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7ef4 expref: 11 pid: 14763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127483.242736:0:14763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7bbd96600, rc 0) 00000100:00100000:3.0:1789127483.242837:0:14763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b5237c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24264358-ed5d-48f3-a95a-0a1ee90442a0+11:14068:x1876035733926400:12345-192.168.206.40@tcp:101:mount.lustre.0 Request processed in 194us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127483.242844:0:14763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 91 00000100:00100000:2.0:1789127483.275885:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127483.276017:0:14761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733926528 00000100:00100000:3.0:1789127483.276038:0:14761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733926528 00000100:00100000:3.0:1789127483.276112:0:14761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 92 00000100:00100000:3.0:1789127483.276123:0:14761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b5236050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24264358-ed5d-48f3-a95a-0a1ee90442a0+11:14068:x1876035733926528:12345-192.168.206.40@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789127483.276410:0:14761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b5236050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24264358-ed5d-48f3-a95a-0a1ee90442a0+11:14068:x1876035733926528:12345-192.168.206.40@tcp:501:mount.lustre.0 Request processed in 288us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127483.276419:0:14761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 92 00000100:00100000:1.0:1789127483.290377:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127483.290591:0:14764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733926656 00000100:00100000:0.0:1789127483.290600:0:14764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733926656 00000100:00100000:0.0:1789127483.290654:0:14764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 93 00000100:00100000:0.0:1789127483.290675:0:14764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b5237450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24264358-ed5d-48f3-a95a-0a1ee90442a0+11:14068:x1876035733926656:12345-192.168.206.40@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789127483.291435:0:14764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b5237450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24264358-ed5d-48f3-a95a-0a1ee90442a0+11:14068:x1876035733926656:12345-192.168.206.40@tcp:503:mount.lustre.0 Request processed in 769us (1065us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127483.291445:0:14764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 93 00000100:00100000:2.0:1789127483.314868:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127483.315067:0:14763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733926784 00000100:00100000:0.0:1789127483.315079:0:14763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733926784 00000100:00100000:0.0:1789127483.315152:0:14763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 94 00000100:00100000:0.0:1789127483.315163:0:14763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b5234450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24264358-ed5d-48f3-a95a-0a1ee90442a0+11:14073:x1876035733926784:12345-192.168.206.40@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789127483.315420:0:14763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b5234450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24264358-ed5d-48f3-a95a-0a1ee90442a0+11:14073:x1876035733926784:12345-192.168.206.40@tcp:502:llog_process_th.0 Request processed in 258us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127483.315428:0:14763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 94 00000100:00100000:1.0:1789127483.338380:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127483.338619:0:14761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733926912 00000100:00100000:3.0:1789127483.338628:0:14761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733926912 00000100:00100000:3.0:1789127483.338681:0:14761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 95 00000100:00100000:3.0:1789127483.338689:0:14761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b5237850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24264358-ed5d-48f3-a95a-0a1ee90442a0+11:14073:x1876035733926912:12345-192.168.206.40@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789127483.339002:0:14761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b5237850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24264358-ed5d-48f3-a95a-0a1ee90442a0+11:14073:x1876035733926912:12345-192.168.206.40@tcp:502:llog_process_th.0 Request processed in 312us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127483.339011:0:14761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 95 00000100:00100000:1.0:1789127483.356424:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127483.358763:0:14764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733927040 00000100:00100000:0.0:1789127483.358776:0:14764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733927040 00000100:00100000:0.0:1789127483.358863:0:14764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 96 00000100:00100000:0.0:1789127483.358873:0:14764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b5234850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24264358-ed5d-48f3-a95a-0a1ee90442a0+11:14068:x1876035733927040:12345-192.168.206.40@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789127483.358888:0:14764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127483.358906:0:14764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df7ae728600/0xeeacf7c024301823 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7f1e expref: -99 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127483.359253:0:14764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df7ae728600/0xeeacf7c024301823 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7f1e expref: 12 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127483.359266:0:14764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df7ae728600/0xeeacf7c024301823 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7f1e expref: 12 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127483.359292:0:14764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7ae728600, rc 0) 00000100:00100000:0.0:1789127483.359359:0:14764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b5234850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24264358-ed5d-48f3-a95a-0a1ee90442a0+12:14068:x1876035733927040:12345-192.168.206.40@tcp:101:mount.lustre.0 Request processed in 487us (2944us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127483.359367:0:14764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 96 00000100:00100000:2.0:1789127483.363881:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127483.364236:0:14763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733927168 00000100:00100000:0.0:1789127483.364246:0:14763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733927168 00000100:00100000:0.0:1789127483.364336:0:14763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 97 00000100:00100000:0.0:1789127483.364347:0:14763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b5237050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24264358-ed5d-48f3-a95a-0a1ee90442a0+12:14068:x1876035733927168:12345-192.168.206.40@tcp:256:mount.lustre.0 20000000:01000000:0.0:1789127483.364371:0:14763:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789127483.364389:0:14763:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789127483.364392:0:14763:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789127483.364396:0:14763:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789127483.364398:0:14763:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:3.0:1789127483.370692:0:14763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b5237050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24264358-ed5d-48f3-a95a-0a1ee90442a0+12:14068:x1876035733927168:12345-192.168.206.40@tcp:256:mount.lustre.0 Request processed in 6334us (6893us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127483.370706:0:14763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 97 00000100:00100000:1.0:1789127483.375019:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127483.375282:0:14764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733927296 00000100:00100000:0.0:1789127483.375292:0:14764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733927296 00000100:00100000:0.0:1789127483.375347:0:14764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 98 00000100:00100000:0.0:1789127483.375357:0:14764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b5235050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24264358-ed5d-48f3-a95a-0a1ee90442a0+12:14068:x1876035733927296:12345-192.168.206.40@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789127483.375375:0:14764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127483.375392:0:14764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df7ae729e00/0xeeacf7c02430182a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7f25 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127483.375418:0:14764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df7ae729e00/0xeeacf7c02430182a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7f25 expref: 13 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127483.375429:0:14764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df7ae729e00/0xeeacf7c02430182a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7f25 expref: 13 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127483.375468:0:14764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7ae729e00, rc 0) 00000100:00100000:0.0:1789127483.375530:0:14764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b5235050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24264358-ed5d-48f3-a95a-0a1ee90442a0+13:14068:x1876035733927296:12345-192.168.206.40@tcp:101:mount.lustre.0 Request processed in 173us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127483.375536:0:14764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 98 00000100:00100000:2.0:1789127483.378213:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127483.378468:0:14763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733927424 00000100:00100000:3.0:1789127483.378477:0:14763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733927424 00000100:00100000:3.0:1789127483.378530:0:14763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 99 00000100:00100000:3.0:1789127483.378540:0:14763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b5235850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24264358-ed5d-48f3-a95a-0a1ee90442a0+13:14068:x1876035733927424:12345-192.168.206.40@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789127483.379031:0:14763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b5235850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24264358-ed5d-48f3-a95a-0a1ee90442a0+13:14068:x1876035733927424:12345-192.168.206.40@tcp:501:mount.lustre.0 Request processed in 490us (823us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127483.379040:0:14763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 99 00000100:00100000:2.0:1789127483.382049:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127483.382248:0:14761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733927552 00000100:00100000:3.0:1789127483.382257:0:14761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733927552 00000100:00100000:3.0:1789127483.382370:0:14761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 100 00000100:00100000:3.0:1789127483.382380:0:14761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b5234050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24264358-ed5d-48f3-a95a-0a1ee90442a0+13:14068:x1876035733927552:12345-192.168.206.40@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789127483.382597:0:14761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b5234050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24264358-ed5d-48f3-a95a-0a1ee90442a0+13:14068:x1876035733927552:12345-192.168.206.40@tcp:503:mount.lustre.0 Request processed in 218us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127483.382606:0:14761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 100 00000100:00100000:1.0:1789127483.386607:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127483.387426:0:14764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733927680 00000100:00100000:0.0:1789127483.387446:0:14764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733927680 00000100:00100000:0.0:1789127483.387504:0:14764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 101 00000100:00100000:0.0:1789127483.387513:0:14764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b5666c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24264358-ed5d-48f3-a95a-0a1ee90442a0+13:14075:x1876035733927680:12345-192.168.206.40@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789127483.388410:0:14764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b5666c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24264358-ed5d-48f3-a95a-0a1ee90442a0+13:14075:x1876035733927680:12345-192.168.206.40@tcp:502:llog_process_th.0 Request processed in 894us (1809us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127483.388421:0:14764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 101 00000100:00100000:0.0:1789127483.392777:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127483.393147:0:14761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733927808 00000100:00100000:3.0:1789127483.393158:0:14761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733927808 00000100:00100000:3.0:1789127483.393217:0:14761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 102 00000100:00100000:3.0:1789127483.393227:0:14761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b5666850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24264358-ed5d-48f3-a95a-0a1ee90442a0+13:14075:x1876035733927808:12345-192.168.206.40@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789127483.393482:0:14761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b5666850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24264358-ed5d-48f3-a95a-0a1ee90442a0+13:14075:x1876035733927808:12345-192.168.206.40@tcp:502:llog_process_th.0 Request processed in 256us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127483.393491:0:14761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 102 00000100:00100000:1.0:1789127483.408593:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127483.409035:0:14769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733927936 00000100:00100000:2.0:1789127483.409055:0:14769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733927936 00000100:00100000:2.0:1789127483.409111:0:14769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 10 00000100:00100000:2.0:1789127483.409120:0:14769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae2fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2345:x1876035733927936:12345-192.168.206.40@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789127483.409157:0:14769:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from a6d4506c-e796-46af-9a51-8e6246e70f67@192.168.206.40@tcp t0 exp 0000000000000000 cur 429 last 0 00000020:00000080:2.0:1789127483.409192:0:14769:0:(genops.c:1385:class_connect()) connect: client a6d4506c-e796-46af-9a51-8e6246e70f67, cookie 0xeeacf7c024301831 00000004:00100000:2.0:1789127483.409223:0:14769:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1789127483.409337:0:14769:0:(import.c:65:import_set_state_nolock()) ffff8df791490800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789127483.409409:0:14769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae2fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a6d4506c-e796-46af-9a51-8e6246e70f67+6:2345:x1876035733927936:12345-192.168.206.40@tcp:38:mount.lustre.0 Request processed in 287us (823us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127483.409417:0:14769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 10 00000100:00100000:1.0:1789127483.413330:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127483.413375:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127483.413403:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127483.413495:0:15457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733928320 00000100:00100000:3.0:1789127483.413504:0:15457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733928320 00000100:00100000:3.0:1789127483.413556:0:15457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733928192 00000100:00100000:3.0:1789127483.413559:0:15457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733928192 00000100:00100000:3.0:1789127483.413575:0:15457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 3 00000100:00100000:3.0:1789127483.413584:0:15457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae2f8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:120b6615-98eb-47cd-be5f-d74b7a580836+5:2346:x1876035733928320:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:3.0:1789127483.413648:0:15457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae2f8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:120b6615-98eb-47cd-be5f-d74b7a580836+5:2346:x1876035733928320:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 65us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127483.413655:0:15457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 3 00000100:00100000:3.0:1789127483.413673:0:15457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 4 00000100:00100000:3.0:1789127483.413679:0:15457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae2fa940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:120b6615-98eb-47cd-be5f-d74b7a580836+5:2346:x1876035733928192:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:3.0:1789127483.413703:0:15457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae2fa940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:120b6615-98eb-47cd-be5f-d74b7a580836+5:2346:x1876035733928192:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 24us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127483.413724:0:15457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 4 00000100:00100000:0.0:1789127483.416470:0:14771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733928064 00000100:00100000:0.0:1789127483.416486:0:14771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733928064 00000100:00100000:0.0:1789127483.416557:0:14771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 16 00000100:00100000:0.0:1789127483.416566:0:14771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae2fad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:120b6615-98eb-47cd-be5f-d74b7a580836+7:2346:x1876035733928064:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:0.0:1789127483.416641:0:14771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae2fad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:120b6615-98eb-47cd-be5f-d74b7a580836+7:2346:x1876035733928064:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 76us (3320us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127483.416648:0:14771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 16 00000100:00100000:1.0:1789127483.426393:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127483.428455:0:14769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733928448 00000100:00100000:2.0:1789127483.428468:0:14769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733928448 00000100:00100000:2.0:1789127483.428551:0:14769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 11 00000100:00100000:2.0:1789127483.428560:0:14769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae2f92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a6d4506c-e796-46af-9a51-8e6246e70f67+6:0:x1876035733928448:12345-192.168.206.40@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789127483.428590:0:14769:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789127483.428663:0:14769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae2f92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a6d4506c-e796-46af-9a51-8e6246e70f67+6:0:x1876035733928448:12345-192.168.206.40@tcp:41:mount.lustre.0 Request processed in 102us (2278us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127483.428671:0:14769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 11 00000100:00080000:3.0:1789127483.429704:0:14765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789127483.430539:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127483.430630:0:14771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733928576 00000100:00100000:2.0:1789127483.430638:0:14771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733928576 00000100:00100000:2.0:1789127483.430691:0:14771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 12 00000100:00100000:2.0:1789127483.430699:0:14771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae2f83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a6d4506c-e796-46af-9a51-8e6246e70f67+6:14068:x1876035733928576:12345-192.168.206.40@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789127483.430725:0:14771:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789127483.430840:0:14771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae2f83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a6d4506c-e796-46af-9a51-8e6246e70f67+6:14068:x1876035733928576:12345-192.168.206.40@tcp:41:mount.lustre.0 Request processed in 140us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127483.430847:0:14771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 12 00000100:00100000:1.0:1789127483.443310:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127483.443914:0:14769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733928704 00000100:00100000:2.0:1789127483.443923:0:14769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733928704 00000100:00100000:2.0:1789127483.443987:0:14769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 13 00000100:00100000:2.0:1789127483.443997:0:14769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae2f9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a6d4506c-e796-46af-9a51-8e6246e70f67+6:14068:x1876035733928704:12345-192.168.206.40@tcp:40:mount.lustre.0 00000100:00100000:2.0:1789127483.444092:0:14769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae2f9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a6d4506c-e796-46af-9a51-8e6246e70f67+6:14068:x1876035733928704:12345-192.168.206.40@tcp:40:mount.lustre.0 Request processed in 96us (789us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127483.444100:0:14769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 13 00000100:00100000:1.0:1789127483.462912:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127483.462948:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127483.462987:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127483.463263:0:14773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733929088 00000100:00100000:3.0:1789127483.463273:0:14773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733929088 00000100:00100000:3.0:1789127483.463326:0:14773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 1 00000100:00100000:3.0:1789127483.463336:0:14773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6820bc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a6d4506c-e796-46af-9a51-8e6246e70f67+6:14068:x1876035733929088:12345-192.168.206.40@tcp:33:mount.lustre.0 00000004:00200000:3.0:1789127483.463554:0:14773:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:3.0:1789127483.463688:0:14773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6820bc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a6d4506c-e796-46af-9a51-8e6246e70f67+6:14068:x1876035733929088:12345-192.168.206.40@tcp:33:mount.lustre.0 Request processed in 353us (782us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127483.463696:0:14773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 1 00000100:00100000:0.0:1789127483.464173:0:15457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733928832 00000100:00100000:0.0:1789127483.464179:0:15457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733928832 00000100:00100000:0.0:1789127483.464211:0:15457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733928960 00000100:00100000:0.0:1789127483.464214:0:15457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733928960 00000100:00100000:0.0:1789127483.464228:0:15457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 10 00000100:00100000:0.0:1789127483.464233:0:15457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df682e70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2345:x1876035733928832:12345-192.168.206.40@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789127483.464263:0:15457:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from a6d4506c-e796-46af-9a51-8e6246e70f67@192.168.206.40@tcp t0 exp 0000000000000000 cur 429 last 0 00000020:00000080:0.0:1789127483.464289:0:15457:0:(genops.c:1385:class_connect()) connect: client a6d4506c-e796-46af-9a51-8e6246e70f67, cookie 0xeeacf7c024301838 00002000:00100000:0.0:1789127483.464300:0:15457:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a6d4506c-e796-46af-9a51-8e6246e70f67/ffff8df7861ed000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113987 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789127483.464310:0:15457:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789127483.464487:0:15457:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789127483.464513:0:15457:0:(import.c:65:import_set_state_nolock()) ffff8df7861e9800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789127483.464557:0:15457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df682e70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a6d4506c-e796-46af-9a51-8e6246e70f67+6:2345:x1876035733928832:12345-192.168.206.40@tcp:8:mount.lustre.0 Request processed in 323us (1608us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127483.464565:0:15457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 10 00000100:00100000:0.0:1789127483.464580:0:15457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 11 00000100:00100000:0.0:1789127483.464584:0:15457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df682e70b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2345:x1876035733928960:12345-192.168.206.40@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789127483.464597:0:15457:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from a6d4506c-e796-46af-9a51-8e6246e70f67@192.168.206.40@tcp t0 exp 0000000000000000 cur 429 last 0 00000020:00000080:0.0:1789127483.464611:0:15457:0:(genops.c:1385:class_connect()) connect: client a6d4506c-e796-46af-9a51-8e6246e70f67, cookie 0xeeacf7c02430183f 00002000:00100000:0.0:1789127483.464616:0:15457:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a6d4506c-e796-46af-9a51-8e6246e70f67/ffff8df786136000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113987 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789127483.464621:0:15457:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789127483.464743:0:15457:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789127483.464759:0:15457:0:(import.c:65:import_set_state_nolock()) ffff8df786132800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789127483.464784:0:15457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df682e70b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a6d4506c-e796-46af-9a51-8e6246e70f67+6:2345:x1876035733928960:12345-192.168.206.40@tcp:8:mount.lustre.0 Request processed in 197us (1796us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127483.464832:0:15457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 11 00000100:00100000:1.0:1789127483.665441:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127483.665560:0:14770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733929216 00000100:00100000:0.0:1789127483.665568:0:14770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733929216 00000100:00100000:0.0:1789127483.665619:0:14770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 14 00000100:00100000:0.0:1789127483.665628:0:14770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df682e72580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a6d4506c-e796-46af-9a51-8e6246e70f67+6:14097:x1876035733929216:12345-192.168.206.40@tcp:101:mkdir.0 00010000:00010000:0.0:1789127483.665658:0:14770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127483.665678:0:14770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729800/0xeeacf7c024301846 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7f4f expref: -99 pid: 14770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127483.665731:0:14770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729000/0xeeacf7c02430184d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127483.665743:0:14770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729000/0xeeacf7c02430184d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127483.665753:0:14770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729000/0xeeacf7c02430184d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789127483.665950:0:14770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1789127483.665954:0:14770:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1789127483.666031:0:14770:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729000/0xeeacf7c02430184d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127483.666056:0:14770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729800/0xeeacf7c024301846 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7f4f expref: 8 pid: 14770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127483.666070:0:14770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729000/0xeeacf7c02430184d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7f4f expref: 7 pid: 14770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127483.666078:0:14770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df79f06cb00) 00010000:00010000:0.0:1789127483.666081:0:14770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789127483.666084:0:14770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7ae729000, rc 0) 00000100:00100000:0.0:1789127483.666330:0:14770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df682e72580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a6d4506c-e796-46af-9a51-8e6246e70f67+7:14097:x1876035733929216:12345-192.168.206.40@tcp:101:mkdir.0 Request processed in 701us (906us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127483.666337:0:14770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 14 00010000:00010000:0.0:1789127484.147024:0:16036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789127484.596416:0:14801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789127485.172056:0:14758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127485.428926:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789127485.428945:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df682e730c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752796032:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789127485.429007:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127485.430248:0:15459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752796032 00000100:00100000:0.0:1789127485.430259:0:15459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752796032 00000100:00100000:0.0:1789127485.430325:0:15459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789127485.430334:0:15459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df682e73c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876035752796032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789127485.430367:0:15459:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789127485.430426:0:15459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df682e73c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876035752796032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (1419us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127485.430433:0:15459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789127485.430676:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df682e721c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1876035752796288:0@lo:400:kworker.0 00000100:00100000:1.0:1789127485.430712:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127485.430737:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789127485.430742:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df682e70f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:396611f1-c34a-4e5a-8396-03624226b0e0:3301:1876035752796160:0@lo:400:kworker.0 00000100:00100000:1.0:1789127485.430809:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127485.430832:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df682e71680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1876035752796672:0@lo:400:kworker.0 00000100:00100000:1.0:1789127485.430858:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127485.430883:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df682e703c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1876035752796544:0@lo:400:kworker.0 00000100:00100000:1.0:1789127485.430905:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127485.430923:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789127485.430928:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df682e712c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876035752796416:0@lo:400:kworker.0 00000100:00100000:1.0:1789127485.430947:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127485.430970:0:15457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752796288 00000100:00100000:1.0:1789127485.430974:0:15457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752796288 00000100:00100000:1.0:1789127485.431001:0:15457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789127485.431008:0:15457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df682e72940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1876035752796288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127485.431045:0:15457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df682e72940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1876035752796288:12345-0@lo:400:kworker.0 Request processed in 37us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127485.431051:0:15457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789127485.431085:0:14769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752796672 00000100:00100000:1.0:1789127485.431089:0:14769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752796672 00000100:00100000:1.0:1789127485.431124:0:14769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752796544 00000100:00100000:1.0:1789127485.431126:0:14769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752796544 00000100:00100000:1.0:1789127485.431137:0:14769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752796416 00000100:00100000:1.0:1789127485.431139:0:14769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752796416 00000100:00100000:1.0:1789127485.431153:0:14769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789127485.431158:0:14769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df682e71e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876035752796672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127485.431187:0:14769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df682e71e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876035752796672:12345-0@lo:400:kworker.0 Request processed in 28us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127485.431194:0:14769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789127485.431207:0:14769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789127485.431221:0:14769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df682e70780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876035752796544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127485.431255:0:14769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df682e70780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876035752796544:12345-0@lo:400:kworker.0 Request processed in 35us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127485.431261:0:14769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789127485.431275:0:14769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789127485.431280:0:14769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df682e73840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876035752796416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127485.431305:0:14769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df682e73840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876035752796416:12345-0@lo:400:kworker.0 Request processed in 25us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127485.431311:0:14769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789127485.431354:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df682e712c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876035752796416:0@lo:400:kworker.0 00000100:00100000:1.0:1789127485.431365:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df682e703c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1876035752796544:0@lo:400:kworker.0 00000100:00100000:1.0:1789127485.431398:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df682e730c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752796032:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789127485.431417:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df682e71680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1876035752796672:0@lo:400:kworker.0 00000100:00100000:1.0:1789127485.431425:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df682e721c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1876035752796288:0@lo:400:kworker.0 00000100:00100000:0.0:1789127485.431575:0:14764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752796160 00000100:00100000:0.0:1789127485.431579:0:14764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752796160 00000100:00100000:0.0:1789127485.431612:0:14764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789127485.431618:0:14764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b5665c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:396611f1-c34a-4e5a-8396-03624226b0e0+19:3301:x1876035752796160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127485.431653:0:14764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b5665c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:396611f1-c34a-4e5a-8396-03624226b0e0+19:3301:x1876035752796160:12345-0@lo:400:kworker.0 Request processed in 35us (867us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127485.431659:0:14764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:3.0:1789127485.431756:0:14765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789127485.431761:0:14765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789127485.431763:0:14765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789127485.432034:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df682e70f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:396611f1-c34a-4e5a-8396-03624226b0e0:3301:1876035752796160:0@lo:400:kworker.0 00000001:00100000:1.0:1789127485.541335:0:5852:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 120b6615-98eb-47cd-be5f-d74b7a580836 00000001:00100000:1.0:1789127485.541350:0:5852:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a6d4506c-e796-46af-9a51-8e6246e70f67 00000001:00100000:0.0:1789127486.031320:0:7646:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a6d4506c-e796-46af-9a51-8e6246e70f67 00010000:00010000:2.0:1789127486.198834:0:14757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789127486.988148:0:16738:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:2.0:1789127487.074529:0:6714:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a6d4506c-e796-46af-9a51-8e6246e70f67 00010000:00010000:3.0:1789127487.232300:0:16036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127487.483328:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae043480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1876035752796800:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789127487.483399:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127487.483534:0:15459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752796800 00000100:00100000:0.0:1789127487.483542:0:15459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752796800 00000100:00100000:0.0:1789127487.483606:0:15459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789127487.483616:0:15459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df682e721c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876035752796800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789127487.483647:0:15459:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1789127487.483710:0:14765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789127487.487137:0:15459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df682e721c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876035752796800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3516us (3730us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127487.487150:0:15459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789127487.488733:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae043480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1876035752796800:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789127488.242979:0:14758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127488.743974:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127488.744013:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127488.744070:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127488.744110:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127488.744132:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127488.744153:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127488.744181:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127488.744207:0:15455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733929600 00000100:00100000:3.0:1789127488.744216:0:15455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733929600 00000100:00100000:3.0:1789127488.744263:0:15455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733930112 00000100:00100000:3.0:1789127488.744266:0:15455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733930112 00000100:00100000:3.0:1789127488.744281:0:15455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733929728 00000100:00100000:3.0:1789127488.744283:0:15455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733929728 00000100:00100000:3.0:1789127488.744314:0:15455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733929984 00000100:00100000:3.0:1789127488.744317:0:15455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733929984 00000100:00100000:3.0:1789127488.744332:0:15455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 6 00000100:00100000:3.0:1789127488.744340:0:15455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae043840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:120b6615-98eb-47cd-be5f-d74b7a580836+5:2346:x1876035733929600:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:3.0:1789127488.744406:0:15455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae043840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:120b6615-98eb-47cd-be5f-d74b7a580836+5:2346:x1876035733929600:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 66us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127488.744413:0:15455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 6 00000100:00100000:3.0:1789127488.744429:0:15455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 7 00000100:00100000:3.0:1789127488.744435:0:15455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae042580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a6d4506c-e796-46af-9a51-8e6246e70f67+5:2346:x1876035733930112:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:3.0:1789127488.744460:0:15455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae042580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a6d4506c-e796-46af-9a51-8e6246e70f67+5:2346:x1876035733930112:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 25us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127488.744465:0:15455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 7 00000100:00100000:3.0:1789127488.744477:0:15455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 8 00000100:00100000:3.0:1789127488.744483:0:15455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae0430c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:120b6615-98eb-47cd-be5f-d74b7a580836+5:2346:x1876035733929728:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:3.0:1789127488.744506:0:15455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae0430c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:120b6615-98eb-47cd-be5f-d74b7a580836+5:2346:x1876035733929728:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 23us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127488.744512:0:15455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 8 00000100:00100000:3.0:1789127488.744523:0:15455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 9 00000100:00100000:3.0:1789127488.744529:0:15455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df68265c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a6d4506c-e796-46af-9a51-8e6246e70f67+5:2346:x1876035733929984:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:3.0:1789127488.744551:0:15455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df68265c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a6d4506c-e796-46af-9a51-8e6246e70f67+5:2346:x1876035733929984:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 22us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127488.744557:0:15455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 9 00000100:00100000:3.0:1789127488.744576:0:14769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733929856 00000100:00100000:3.0:1789127488.744580:0:14769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733929856 00000100:00100000:3.0:1789127488.744617:0:14769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733929472 00000100:00100000:3.0:1789127488.744620:0:14769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733929472 00000100:00100000:3.0:1789127488.744641:0:14769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 20 00000100:00100000:3.0:1789127488.744647:0:14769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae041e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a6d4506c-e796-46af-9a51-8e6246e70f67+6:2346:x1876035733929856:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:3.0:1789127488.744675:0:14769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae041e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a6d4506c-e796-46af-9a51-8e6246e70f67+6:2346:x1876035733929856:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 28us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127488.744682:0:14769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 20 00000100:00100000:3.0:1789127488.744695:0:14769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 21 00000100:00100000:3.0:1789127488.744702:0:14769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae043480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:120b6615-98eb-47cd-be5f-d74b7a580836+6:2346:x1876035733929472:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:3.0:1789127488.744726:0:14769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae043480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:120b6615-98eb-47cd-be5f-d74b7a580836+6:2346:x1876035733929472:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 25us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127488.744732:0:14769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 21 00000100:00080000:3.0:1789127488.744755:0:14765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789127488.744760:0:14765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789127488.744762:0:14765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789127488.745873:0:14763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733929344 00000100:00100000:0.0:1789127488.745892:0:14763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733929344 00000100:00100000:0.0:1789127488.745939:0:14763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 104 00000100:00100000:0.0:1789127488.745947:0:14763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b5666450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24264358-ed5d-48f3-a95a-0a1ee90442a0+13:2346:x1876035733929344:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:0.0:1789127488.746000:0:14763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b5666450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24264358-ed5d-48f3-a95a-0a1ee90442a0+13:2346:x1876035733929344:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 54us (2037us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127488.746007:0:14763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 104 00010000:00010000:2.0:1789127489.267989:0:14757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127490.291007:0:16036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127490.550131:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df682c712c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1876035752797056:0@lo:400:kworker.0 00000100:00100000:0.0:1789127490.550209:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127490.550260:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df682c71a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1876035752797568:0@lo:400:kworker.0 00000100:00100000:0.0:1789127490.550288:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127490.550311:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789127490.550317:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df682c703c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:396611f1-c34a-4e5a-8396-03624226b0e0:3303:1876035752796928:0@lo:400:kworker.0 00000100:00100000:0.0:1789127490.550345:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127490.550366:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df682c73c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1876035752797440:0@lo:400:kworker.0 00000100:00100000:0.0:1789127490.550386:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127490.550412:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df682c73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1876035752797184:0@lo:400:kworker.0 00000100:00100000:0.0:1789127490.550433:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127490.550451:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789127490.550455:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df682c70f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876035752797312:0@lo:400:kworker.0 00000100:00100000:0.0:1789127490.550476:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127490.550506:0:15455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752797056 00000100:00100000:0.0:1789127490.550513:0:15455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752797056 00000100:00100000:0.0:1789127490.550557:0:15455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752797184 00000100:00100000:0.0:1789127490.550560:0:15455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752797184 00000100:00100000:0.0:1789127490.550578:0:15455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789127490.550596:0:15455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df682c72940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1876035752797056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127490.550646:0:15455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df682c72940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1876035752797056:12345-0@lo:400:kworker.0 Request processed in 51us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127490.550667:0:15455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789127490.550684:0:15455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789127490.550690:0:15455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df682c70b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1876035752797184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127490.550722:0:15455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df682c70b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1876035752797184:12345-0@lo:400:kworker.0 Request processed in 32us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127490.550728:0:15455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789127490.550746:0:14769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752797568 00000100:00100000:0.0:1789127490.550749:0:14769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752797568 00000100:00100000:0.0:1789127490.550772:0:14769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752797440 00000100:00100000:0.0:1789127490.550775:0:14769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752797440 00000100:00100000:0.0:1789127490.550812:0:14769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752797312 00000100:00100000:0.0:1789127490.550815:0:14769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752797312 00000100:00100000:0.0:1789127490.550830:0:14769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789127490.550836:0:14769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df682c72580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876035752797568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127490.550866:0:14769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df682c72580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876035752797568:12345-0@lo:400:kworker.0 Request processed in 30us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127490.550872:0:14769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789127490.550885:0:14769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789127490.550890:0:14769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df682c73840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876035752797440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127490.550915:0:14769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df682c73840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876035752797440:12345-0@lo:400:kworker.0 Request processed in 25us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127490.550921:0:14769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789127490.550932:0:14769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789127490.550938:0:14769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df682c730c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876035752797312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127490.550973:0:14769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df682c730c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876035752797312:12345-0@lo:400:kworker.0 Request processed in 35us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127490.550979:0:14769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789127490.550997:0:14761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752796928 00000100:00100000:0.0:1789127490.551000:0:14761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752796928 00000100:00100000:0.0:1789127490.551022:0:14761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789127490.551028:0:14761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b5664c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:396611f1-c34a-4e5a-8396-03624226b0e0+19:3303:x1876035752796928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127490.551056:0:14761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b5664c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:396611f1-c34a-4e5a-8396-03624226b0e0+19:3303:x1876035752796928:12345-0@lo:400:kworker.0 Request processed in 28us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127490.551062:0:14761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:0.0:1789127490.551104:0:14765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789127490.551108:0:14765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789127490.551110:0:14765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789127490.551140:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df682c70f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876035752797312:0@lo:400:kworker.0 00000100:00100000:0.0:1789127490.551151:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df682c73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1876035752797184:0@lo:400:kworker.0 00000100:00100000:0.0:1789127490.551178:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df682c703c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:396611f1-c34a-4e5a-8396-03624226b0e0:3303:1876035752796928:0@lo:400:kworker.0 00000100:00100000:0.0:1789127490.551187:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df682c73c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1876035752797440:0@lo:400:kworker.0 00000100:00100000:0.0:1789127490.551196:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df682c712c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1876035752797056:0@lo:400:kworker.0 00000100:00100000:0.0:1789127490.551204:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df682c71a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1876035752797568:0@lo:400:kworker.0 00000100:00100000:2.0:1789127490.558115:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789127490.558136:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6826a4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1876035752797696:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789127490.558210:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127490.558254:0:15459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752797696 00000100:00100000:2.0:1789127490.558260:0:15459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752797696 00000100:00100000:2.0:1789127490.558301:0:15459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789127490.558310:0:15459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6826a6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876035752797696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789127490.558342:0:15459:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789127490.558386:0:15459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6826a6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876035752797696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127490.558394:0:15459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789127490.558439:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6826a4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1876035752797696:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789127491.320187:0:14758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789127491.327174:0:16887:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffce75a10c0 20000000:00000080:3.0:1789127491.327192:0:16887:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8df681bee800 uarg=0000000000000000 20000000:01000000:3.0:1789127491.327225:0:16887:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789127491.327230:0:16887:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789127491.327234:0:16887:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1789127491.329221:0:16888:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:3.0:1789127491.329357:0:16887:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1789127491.341205:0:16887:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789127491.341234:0:16887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8df7bbd97800/0xeeacf7c024301854 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127491.341252:0:16887:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df7c2051e00/0xeeacf7c02430154b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c024301544 expref: 18 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127491.341274:0:16887:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df7bbd96400/0xeeacf7c024301598 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c024301591 expref: 18 pid: 14761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127491.341280:0:16887:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df7aeab7e00/0xeeacf7c0243016d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c0243016cc expref: 18 pid: 14761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127491.341291:0:16887:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df6820ac200/0xeeacf7c0243017f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7ec3 expref: 12 pid: 14761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127491.341298:0:16887:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df7ae729e00/0xeeacf7c02430182a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7f25 expref: 12 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127491.341306:0:16887:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8df7bbd97800/0xeeacf7c024301854 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127491.341346:0:16887:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df7ae729e00/0xeeacf7c02430182a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7f25 expref: 12 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127491.341361:0:16887:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df7ae729e00/0xeeacf7c02430182a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7f25 expref: 12 pid: 14764 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127491.341375:0:16887:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df68265f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16887:1876035752797824:192.168.206.40@tcp:104: 00010000:00010000:3.0:1789127491.343415:0:16887:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df6820ac200/0xeeacf7c0243017f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7ec3 expref: 12 pid: 14761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127491.343431:0:16887:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df6820ac200/0xeeacf7c0243017f2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7ec3 expref: 12 pid: 14761 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127491.343443:0:16887:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df68265ed00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16887:1876035752797952:192.168.206.40@tcp:104: 00010000:00010000:3.0:1789127491.344345:0:16887:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df7aeab7e00/0xeeacf7c0243016d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xeeacf7c0243016cc expref: 18 pid: 14761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127491.344357:0:16887:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df7aeab7e00/0xeeacf7c0243016d3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xeeacf7c0243016cc expref: 18 pid: 14761 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127491.344368:0:16887:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df68265e1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16887:1876035752798080:0@lo:104: 00000100:00100000:3.0:1789127491.344406:0:16887:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789127491.344451:0:16887:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df7bbd96400/0xeeacf7c024301598 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xeeacf7c024301591 expref: 18 pid: 14761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127491.344459:0:16887:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df7bbd96400/0xeeacf7c024301598 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xeeacf7c024301591 expref: 18 pid: 14761 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127491.344467:0:16887:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df68265c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16887:1876035752798208:0@lo:104: 00000100:00100000:3.0:1789127491.344502:0:16887:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789127491.344740:0:16887:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df7c2051e00/0xeeacf7c02430154b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xeeacf7c024301544 expref: 18 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127491.344748:0:16887:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df7c2051e00/0xeeacf7c02430154b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xeeacf7c024301544 expref: 18 pid: 14764 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127491.344756:0:16887:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df68265f840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16887:1876035752798336:0@lo:104: 00000100:00100000:3.0:1789127491.344778:0:16887:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127491.347706:0:16887:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df78eee5c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789127491.347857:0:14752:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789127491.347877:0:14752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752798080 00000100:00100000:1.0:1789127491.347883:0:14752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752798080 00000100:00100000:1.0:1789127491.347921:0:14752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752798208 00000100:00100000:1.0:1789127491.347924:0:14752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752798208 00000100:00100000:1.0:1789127491.347935:0:14752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752798336 00000100:00100000:1.0:1789127491.347938:0:14752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752798336 00000100:00100000:1.0:1789127491.347952:0:14752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789127491.347960:0:14752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df68265de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:396611f1-c34a-4e5a-8396-03624226b0e0+5:16887:x1876035752798080:12345-0@lo:104: 00010000:00010000:1.0:1789127491.347977:0:14752:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.140@tcp lock: ffff8df7ae729c00/0xeeacf7c0243016cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xeeacf7c0243016d3 expref: -99 pid: 16175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127491.348263:0:14752:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789127491.348270:0:14752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df68265de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:396611f1-c34a-4e5a-8396-03624226b0e0+5:16887:x1876035752798080:12345-0@lo:104: Request processed in 310us (3864us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127491.348278:0:14752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789127491.348298:0:14752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789127491.348305:0:14752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df68265e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:396611f1-c34a-4e5a-8396-03624226b0e0+4:16887:x1876035752798208:12345-0@lo:104: 00010000:00010000:1.0:1789127491.348313:0:14752:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.140@tcp lock: ffff8df7aeab6200/0xeeacf7c024301591 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xeeacf7c024301598 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127491.348347:0:14752:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789127491.348352:0:14752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df68265e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:396611f1-c34a-4e5a-8396-03624226b0e0+4:16887:x1876035752798208:12345-0@lo:104: Request processed in 48us (3850us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127491.348358:0:14752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789127491.348370:0:14752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789127491.348376:0:14752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae973450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:396611f1-c34a-4e5a-8396-03624226b0e0+3:16887:x1876035752798336:12345-0@lo:104: 00010000:00010000:1.0:1789127491.348384:0:14752:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.140@tcp lock: ffff8df7ae728a00/0xeeacf7c024301544 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xeeacf7c02430154b expref: -99 pid: 14767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127491.348423:0:14752:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789127491.348428:0:14752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae973450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:396611f1-c34a-4e5a-8396-03624226b0e0+3:16887:x1876035752798336:12345-0@lo:104: Request processed in 53us (3649us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127491.348434:0:14752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1789127491.348493:0:14757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789127491.348498:0:14757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.140@tcp lock: ffff8df7ae729c00/0xeeacf7c0243016cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xeeacf7c0243016d3 expref: -99 pid: 16175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127491.348506:0:14757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7ae729c00 already unused, calling callback (ffffffffc1da1c20) 10000000:00010000:1.0:1789127491.349316:0:14757:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.140@tcp lock: ffff8df7ae729c00/0xeeacf7c0243016cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xeeacf7c0243016d3 expref: -99 pid: 16175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127491.349329:0:14757:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: ffff8df7ae729c00/0xeeacf7c0243016cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xeeacf7c0243016d3 expref: -99 pid: 16175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789127491.349336:0:14757:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: ffff8df7ae729c00/0xeeacf7c0243016cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xeeacf7c0243016d3 expref: -99 pid: 16175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789127491.349341:0:14757:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789127491.349377:0:14757:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.140@tcp lock: ffff8df7ae729c00/0xeeacf7c0243016cc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c0243016d3 expref: -99 pid: 16175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127491.349384:0:14757:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789127491.349407:0:14757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.140@tcp lock: ffff8df7ae729c00/0xeeacf7c0243016cc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c0243016d3 expref: -99 pid: 16175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127491.349414:0:14757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: ffff8df7ae729c00/0xeeacf7c0243016cc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c0243016d3 expref: -99 pid: 16175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127491.349441:0:14757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789127491.349445:0:14757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.140@tcp lock: ffff8df7aeab6200/0xeeacf7c024301591 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xeeacf7c024301598 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127491.349451:0:14757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7aeab6200 already unused, calling callback (ffffffffc1da1c20) 10000000:00010000:1.0:1789127491.349454:0:14757:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.140@tcp lock: ffff8df7aeab6200/0xeeacf7c024301591 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xeeacf7c024301598 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127491.349460:0:14757:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: ffff8df7aeab6200/0xeeacf7c024301591 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xeeacf7c024301598 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789127491.349466:0:14757:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: ffff8df7aeab6200/0xeeacf7c024301591 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xeeacf7c024301598 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789127491.349471:0:14757:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789127491.349496:0:14757:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.140@tcp lock: ffff8df7aeab6200/0xeeacf7c024301591 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c024301598 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127491.349502:0:14757:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789127491.349516:0:14757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.140@tcp lock: ffff8df7aeab6200/0xeeacf7c024301591 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c024301598 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127491.349523:0:14757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: ffff8df7aeab6200/0xeeacf7c024301591 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c024301598 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127491.349532:0:14757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789127491.349536:0:14757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.140@tcp lock: ffff8df7ae728a00/0xeeacf7c024301544 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xeeacf7c02430154b expref: -99 pid: 14767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127491.349551:0:14757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7ae728a00 already unused, calling callback (ffffffffc1da1c20) 10000000:00010000:1.0:1789127491.349554:0:14757:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.140@tcp lock: ffff8df7ae728a00/0xeeacf7c024301544 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xeeacf7c02430154b expref: -99 pid: 14767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127491.349560:0:14757:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: ffff8df7ae728a00/0xeeacf7c024301544 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xeeacf7c02430154b expref: -99 pid: 14767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789127491.349565:0:14757:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: ffff8df7ae728a00/0xeeacf7c024301544 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xeeacf7c02430154b expref: -99 pid: 14767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789127491.349569:0:14757:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789127491.349581:0:14757:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.140@tcp lock: ffff8df7ae728a00/0xeeacf7c024301544 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c02430154b expref: -99 pid: 14767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127491.349585:0:14757:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789127491.349590:0:14757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.140@tcp lock: ffff8df7ae728a00/0xeeacf7c024301544 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c02430154b expref: -99 pid: 14767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127491.349596:0:14757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: ffff8df7ae728a00/0xeeacf7c024301544 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xeeacf7c02430154b expref: -99 pid: 14767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127491.349608:0:14757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127491.349610:0:14757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127491.349611:0:14757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127491.349627:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df682e703c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:396611f1-c34a-4e5a-8396-03624226b0e0:3301:1876035752798464:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789127491.350699:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127491.350765:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df682e712c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:396611f1-c34a-4e5a-8396-03624226b0e0:3302:1876035752798592:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789127491.350807:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127491.350837:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789127491.350843:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df682e72d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:396611f1-c34a-4e5a-8396-03624226b0e0:3302:1876035752798720:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789127491.350867:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127491.350896:0:14756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752798464 00000100:00100000:1.0:1789127491.350903:0:14756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752798464 00010000:00010000:1.0:1789127491.350932:0:14756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df7aeab7e00/0xeeacf7c0243016d3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xeeacf7c0243016cc expref: 19 pid: 14761 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127491.350951:0:14756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752798592 00000100:00100000:1.0:1789127491.350954:0:14756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752798592 00010000:00010000:1.0:1789127491.350964:0:14756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df7bbd96400/0xeeacf7c024301598 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xeeacf7c024301591 expref: 20 pid: 14761 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127491.350973:0:14756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752798720 00000100:00100000:1.0:1789127491.350975:0:14756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752798720 00010000:00010000:1.0:1789127491.350984:0:14756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df7c2051e00/0xeeacf7c02430154b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xeeacf7c024301544 expref: 21 pid: 14764 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127491.350994:0:14756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789127491.351001:0:14756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df682e73480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:396611f1-c34a-4e5a-8396-03624226b0e0+21:3301:x1876035752798464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789127491.351026:0:14756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127491.351372:0:16036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127491.351378:0:14758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127491.352451:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127491.352575:0:16887:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df68265f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16887:1876035752797824:192.168.206.40@tcp:104: 00000100:00100000:0.0:1789127491.352589:0:16887:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df68265ed00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16887:1876035752797952:192.168.206.40@tcp:104: 00000100:00100000:0.0:1789127491.352598:0:16887:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df68265e1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16887:1876035752798080:0@lo:104: 00000100:00100000:0.0:1789127491.352619:0:16887:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df68265c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16887:1876035752798208:0@lo:104: 00000100:00100000:0.0:1789127491.352626:0:16887:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df68265f840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16887:1876035752798336:0@lo:104: 00010000:00010000:1.0:1789127491.355927:0:14756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df7aeab7e00/0xeeacf7c0243016d3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xeeacf7c0243016cc expref: 21 pid: 14761 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127491.355954:0:14756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df7aeab7e00/0xeeacf7c0243016d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xeeacf7c0243016cc expref: 21 pid: 14761 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127491.355976:0:14756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df7aeab7e00/0xeeacf7c0243016d3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xeeacf7c0243016cc expref: 21 pid: 14761 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127491.355993:0:14756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789127491.356297:0:16887:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8df7bbd97800/0xeeacf7c024301854 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127491.356370:0:14756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df682e73480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:396611f1-c34a-4e5a-8396-03624226b0e0+20:3301:x1876035752798464:12345-0@lo:103:ldlm_bl.0 Request processed in 5366us (5672us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127491.356380:0:14756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789127491.356407:0:14756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733930240 00000100:00100000:1.0:1789127491.356413:0:14756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733930240 00010000:00010000:1.0:1789127491.356438:0:14756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df7ae729e00/0xeeacf7c02430182a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7f25 expref: 13 pid: 14764 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127491.356455:0:14756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789127491.356462:0:14756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df682e71680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:396611f1-c34a-4e5a-8396-03624226b0e0+19:3302:x1876035752798592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789127491.356483:0:14756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789127491.356488:0:14756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df7bbd96400/0xeeacf7c024301598 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xeeacf7c024301591 expref: 19 pid: 14761 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127491.356496:0:14756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df7bbd96400/0xeeacf7c024301598 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xeeacf7c024301591 expref: 19 pid: 14761 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127491.356507:0:14756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df7bbd96400/0xeeacf7c024301598 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xeeacf7c024301591 expref: 19 pid: 14761 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127491.356515:0:14756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789127491.356551:0:14756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df682e71680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:396611f1-c34a-4e5a-8396-03624226b0e0+18:3302:x1876035752798592:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (5743us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127491.356557:0:14756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789127491.356570:0:14756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789127491.356576:0:14756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b4013450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:396611f1-c34a-4e5a-8396-03624226b0e0+17:3302:x1876035752798720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789127491.356584:0:14756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789127491.356588:0:14756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df7c2051e00/0xeeacf7c02430154b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xeeacf7c024301544 expref: 17 pid: 14764 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127491.356606:0:14756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df7c2051e00/0xeeacf7c02430154b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xeeacf7c024301544 expref: 17 pid: 14764 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127491.356616:0:14756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df7c2051e00/0xeeacf7c02430154b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xeeacf7c024301544 expref: 17 pid: 14764 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127491.356624:0:14756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789127491.356648:0:14756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b4013450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:396611f1-c34a-4e5a-8396-03624226b0e0+16:3302:x1876035752798720:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (5780us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127491.356654:0:14756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789127491.356697:0:14756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 7 00000100:00100000:1.0:1789127491.356704:0:14756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df68265cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:24264358-ed5d-48f3-a95a-0a1ee90442a0+13:2348:x1876035733930240:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789127491.356712:0:14756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789127491.356716:0:14756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df7ae729e00/0xeeacf7c02430182a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7f25 expref: 13 pid: 14764 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127491.356726:0:14756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df7ae729e00/0xeeacf7c02430182a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7f25 expref: 13 pid: 14764 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127491.356736:0:14756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df7ae729e00/0xeeacf7c02430182a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7f25 expref: 13 pid: 14764 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127491.356745:0:14756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789127491.356782:0:14756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df68265cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:24264358-ed5d-48f3-a95a-0a1ee90442a0+12:2348:x1876035733930240:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 79us (4336us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127491.356808:0:14756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 7 00000100:00100000:0.0:1789127491.357439:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df682e72d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:396611f1-c34a-4e5a-8396-03624226b0e0:3302:1876035752798720:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789127491.357450:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df682e712c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:396611f1-c34a-4e5a-8396-03624226b0e0:3302:1876035752798592:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789127491.358312:0:14753:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/1 left), rc = 0 00000100:00100000:3.0:1789127491.358705:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df682e703c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:396611f1-c34a-4e5a-8396-03624226b0e0:3301:1876035752798464:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789127491.359598:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127491.359737:0:14756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733930368 00000100:00100000:1.0:1789127491.359748:0:14756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733930368 00010000:00010000:1.0:1789127491.359780:0:14756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df6820ac200/0xeeacf7c0243017f2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7ec3 expref: 12 pid: 14761 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127491.359840:0:14756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 8 00000100:00100000:1.0:1789127491.359849:0:14756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df68265fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:24264358-ed5d-48f3-a95a-0a1ee90442a0+12:2348:x1876035733930368:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789127491.359861:0:14756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789127491.359865:0:14756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df6820ac200/0xeeacf7c0243017f2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7ec3 expref: 12 pid: 14761 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127491.359877:0:14756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df6820ac200/0xeeacf7c0243017f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7ec3 expref: 12 pid: 14761 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127491.359892:0:14756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df6820ac200/0xeeacf7c0243017f2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7ec3 expref: 12 pid: 14761 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127491.359905:0:14756:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8df7bbd97800/0xeeacf7c024301854 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127491.359913:0:14756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df7bbd97800/0xeeacf7c024301854 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127491.359927:0:14756:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df7bbd97800/0xeeacf7c024301854 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127491.359935:0:14756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df7bbd97800/0xeeacf7c024301854 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127491.359941:0:14756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8df7bbd97800/0xeeacf7c024301854 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127491.359956:0:14756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8df7bbd97800/0xeeacf7c024301854 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127491.359963:0:14756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd97800 already unused, calling callback (ffffffffc17a4550) 00010000:00010000:1.0:1789127491.359966:0:14756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8df7bbd97800/0xeeacf7c024301854 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127491.359974:0:14756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8df7bbd97800/0xeeacf7c024301854 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127491.359989:0:14756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8df7bbd97800/0xeeacf7c024301854 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127491.360001:0:14756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789127491.360080:0:14756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df68265fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:24264358-ed5d-48f3-a95a-0a1ee90442a0+11:2348:x1876035733930368:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 231us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127491.360088:0:14756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 8 00010000:00010000:2.0:1789127491.360291:0:16887:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8df7bbd97800/0xeeacf7c024301854 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127491.360300:0:16887:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8df7bbd97800/0xeeacf7c024301854 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127491.360306:0:16887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df7bbd97800/0xeeacf7c024301854 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127492.341082:0:14757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789127492.531835:0:14767:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789127492.531842:0:14767:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df791481000 from 13 10000000:01000000:0.0:1789127492.531847:0:14767:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789127492.531892:0:14767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df7ae729a00/0xeeacf7c02430185b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127492.531903:0:14767:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff8df7ae729a00/0xeeacf7c02430185b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127492.531913:0:14767:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff8df7ae729a00/0xeeacf7c02430185b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127492.531938:0:14767:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df682c712c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:396611f1-c34a-4e5a-8396-03624226b0e0:14767:1876035752798848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789127492.532013:0:14767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127492.532074:0:14764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752798848 00000100:00100000:0.0:1789127492.532078:0:14767:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7b46be900 going to sleep for 11 seconds 00000100:00100000:3.0:1789127492.532083:0:14764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752798848 00000100:00100000:3.0:1789127492.532133:0:14764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789127492.532142:0:14764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b5667c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:396611f1-c34a-4e5a-8396-03624226b0e0+16:14767:x1876035752798848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789127492.532154:0:14764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127492.532166:0:14764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df7bbd97200/0xeeacf7c024301862 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xeeacf7c02430185b expref: -99 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127492.532194:0:14764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df7bbd97200/0xeeacf7c024301862 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xeeacf7c02430185b expref: 17 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127492.532204:0:14764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df7bbd97200/0xeeacf7c024301862 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c02430185b expref: 17 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127492.532213:0:14764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7bbd97200, rc 0) 00000100:00100000:3.0:1789127492.532518:0:14764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b5667c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:396611f1-c34a-4e5a-8396-03624226b0e0+17:14767:x1876035752798848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 375us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127492.532525:0:14764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789127492.532561:0:14767:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df682c712c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:396611f1-c34a-4e5a-8396-03624226b0e0:14767:1876035752798848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789127492.532578:0:14767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff8df7ae729a00/0xeeacf7c02430185b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c024301862 expref: -99 pid: 14767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127492.532588:0:14767:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff8df7ae729a00/0xeeacf7c02430185b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xeeacf7c024301862 expref: -99 pid: 14767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127492.532661:0:14767:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df682c712c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:396611f1-c34a-4e5a-8396-03624226b0e0:14767:1876035752798976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789127492.532693:0:14767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127492.532724:0:14767:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7b46be900 going to sleep for 11 seconds 00000100:00100000:2.0:1789127492.532816:0:14763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752798976 00000100:00100000:2.0:1789127492.532821:0:14763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752798976 00000100:00100000:2.0:1789127492.532856:0:14763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789127492.532863:0:14763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b5666050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:396611f1-c34a-4e5a-8396-03624226b0e0+17:14767:x1876035752798976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789127492.533142:0:14763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b5666050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:396611f1-c34a-4e5a-8396-03624226b0e0+17:14767:x1876035752798976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 279us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127492.533150:0:14763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789127492.533398:0:14767:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df682c712c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:396611f1-c34a-4e5a-8396-03624226b0e0:14767:1876035752798976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789127492.533436:0:14767:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df68265d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:396611f1-c34a-4e5a-8396-03624226b0e0:14767:1876035752799104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789127492.533489:0:14767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127492.533524:0:14767:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df78600e300 going to sleep for 11 seconds 00000100:00100000:1.0:1789127492.533648:0:14764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752799104 00000100:00100000:1.0:1789127492.533653:0:14764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752799104 00000100:00100000:1.0:1789127492.533686:0:14764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789127492.533693:0:14764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b5667450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:396611f1-c34a-4e5a-8396-03624226b0e0+17:14767:x1876035752799104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789127492.533875:0:14764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b5667450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:396611f1-c34a-4e5a-8396-03624226b0e0+17:14767:x1876035752799104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 182us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127492.533882:0:14764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789127492.534063:0:14767:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df68265d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:396611f1-c34a-4e5a-8396-03624226b0e0:14767:1876035752799104:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789127492.538137:0:16919:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1789127492.539876:0:14767:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1789127492.539909:0:14767:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789127492.539920:0:14767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df7ae729a00/0xeeacf7c02430185b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c024301862 expref: -99 pid: 14767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127492.539932:0:14767:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff8df7ae729a00/0xeeacf7c02430185b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c024301862 expref: -99 pid: 14767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127492.539943:0:14767:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789127492.539946:0:14767:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df682b8a000 from 13 10000000:01000000:0.0:1789127492.539949:0:14767:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789127492.539996:0:14767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df7ae728400/0xeeacf7c024301869 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127492.540005:0:14767:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff8df7ae728400/0xeeacf7c024301869 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127492.540015:0:14767:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff8df7ae728400/0xeeacf7c024301869 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127492.540041:0:14767:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df682c73c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:396611f1-c34a-4e5a-8396-03624226b0e0:14767:1876035752799232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789127492.540749:0:14767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127492.540781:0:14767:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7b46be180 going to sleep for 11 seconds 00000100:00100000:1.0:1789127492.540861:0:14764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752799232 00000100:00100000:1.0:1789127492.540868:0:14764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752799232 00000100:00100000:1.0:1789127492.540917:0:14764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789127492.540926:0:14764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b5664450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:396611f1-c34a-4e5a-8396-03624226b0e0+17:14767:x1876035752799232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789127492.540961:0:14764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127492.540977:0:14764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df6820acc00/0xeeacf7c024301870 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xeeacf7c024301869 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127492.540999:0:14764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df6820acc00/0xeeacf7c024301870 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xeeacf7c024301869 expref: 18 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127492.541010:0:14764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df6820acc00/0xeeacf7c024301870 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c024301869 expref: 18 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127492.541019:0:14764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df6820acc00, rc 0) 00000100:00100000:1.0:1789127492.541081:0:14764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b5664450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:396611f1-c34a-4e5a-8396-03624226b0e0+18:14767:x1876035752799232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 156us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127492.541089:0:14764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789127492.541351:0:14767:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df682c73c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:396611f1-c34a-4e5a-8396-03624226b0e0:14767:1876035752799232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789127492.541368:0:14767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff8df7ae728400/0xeeacf7c024301869 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c024301870 expref: -99 pid: 14767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127492.541386:0:14767:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff8df7ae728400/0xeeacf7c024301869 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xeeacf7c024301870 expref: -99 pid: 14767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127492.541461:0:14767:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df68265d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:396611f1-c34a-4e5a-8396-03624226b0e0:14767:1876035752799360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789127492.541496:0:14767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127492.541526:0:14767:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df786bae000 going to sleep for 11 seconds 00000100:00100000:2.0:1789127492.541645:0:14763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752799360 00000100:00100000:2.0:1789127492.541650:0:14763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752799360 00000100:00100000:2.0:1789127492.541676:0:14763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789127492.541682:0:14763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b5667850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:396611f1-c34a-4e5a-8396-03624226b0e0+18:14767:x1876035752799360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789127492.541939:0:14763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b5667850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:396611f1-c34a-4e5a-8396-03624226b0e0+18:14767:x1876035752799360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 256us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127492.541947:0:14763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789127492.542299:0:14767:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df68265d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:396611f1-c34a-4e5a-8396-03624226b0e0:14767:1876035752799360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789127492.542334:0:14767:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df68265d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:396611f1-c34a-4e5a-8396-03624226b0e0:14767:1876035752799488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789127492.542374:0:14767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127492.542402:0:14767:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df786bae000 going to sleep for 11 seconds 00000100:00100000:2.0:1789127492.542528:0:14763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752799488 00000100:00100000:2.0:1789127492.542533:0:14763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752799488 00000100:00100000:2.0:1789127492.542565:0:14763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789127492.542572:0:14763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b5664850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:396611f1-c34a-4e5a-8396-03624226b0e0+18:14767:x1876035752799488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789127492.542721:0:14763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b5664850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:396611f1-c34a-4e5a-8396-03624226b0e0+18:14767:x1876035752799488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 148us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127492.542728:0:14763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789127492.542874:0:14767:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df68265d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:396611f1-c34a-4e5a-8396-03624226b0e0:14767:1876035752799488:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789127492.543947:0:16920:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1789127492.545240:0:14767:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1789127492.545267:0:14767:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789127492.545289:0:14767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df7ae728400/0xeeacf7c024301869 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c024301870 expref: -99 pid: 14767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127492.545300:0:14767:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff8df7ae728400/0xeeacf7c024301869 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c024301870 expref: -99 pid: 14767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127492.545312:0:14767:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789127492.545314:0:14767:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df7bfc78000 from 13 10000000:01000000:0.0:1789127492.545317:0:14767:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789127492.545350:0:14767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df7ae729400/0xeeacf7c024301877 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127492.545359:0:14767:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff8df7ae729400/0xeeacf7c024301877 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127492.545369:0:14767:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff8df7ae729400/0xeeacf7c024301877 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127492.545392:0:14767:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df682c703c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:396611f1-c34a-4e5a-8396-03624226b0e0:14767:1876035752799616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789127492.545519:0:14767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127492.545608:0:14767:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7b46bee40 going to sleep for 11 seconds 00000100:00100000:2.0:1789127492.545656:0:14763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752799616 00000100:00100000:2.0:1789127492.545662:0:14763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752799616 00000100:00100000:2.0:1789127492.545738:0:14763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789127492.549759:0:14763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b5667050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:396611f1-c34a-4e5a-8396-03624226b0e0+18:14767:x1876035752799616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789127492.549781:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127492.549825:0:14763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df7aeab7a00/0xeeacf7c02430187e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xeeacf7c024301877 expref: -99 pid: 14763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127492.549854:0:14763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df7aeab7a00/0xeeacf7c02430187e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xeeacf7c024301877 expref: 19 pid: 14763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127492.549867:0:14763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df7aeab7a00/0xeeacf7c02430187e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xeeacf7c024301877 expref: 19 pid: 14763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127492.549876:0:14763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7aeab7a00, rc 0) 00000100:00100000:2.0:1789127492.549953:0:14763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b5667050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:396611f1-c34a-4e5a-8396-03624226b0e0+19:14767:x1876035752799616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 4207us (4433us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127492.549972:0:14763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789127492.550160:0:14767:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df682c703c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:396611f1-c34a-4e5a-8396-03624226b0e0:14767:1876035752799616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789127492.550178:0:14767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff8df7ae729400/0xeeacf7c024301877 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c02430187e expref: -99 pid: 14767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127492.550188:0:14767:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff8df7ae729400/0xeeacf7c024301877 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xeeacf7c02430187e expref: -99 pid: 14767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127492.550259:0:14767:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df68265d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:396611f1-c34a-4e5a-8396-03624226b0e0:14767:1876035752799744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789127492.550293:0:14767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127492.551337:0:14767:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df786baed80 going to sleep for 11 seconds 00000100:00100000:0.0:1789127492.551415:0:14761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752799744 00000100:00100000:0.0:1789127492.551422:0:14761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752799744 00000100:00100000:1.0:1789127492.551862:0:14761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789127492.551872:0:14761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7af253450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:396611f1-c34a-4e5a-8396-03624226b0e0+19:14767:x1876035752799744:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789127492.552375:0:14761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7af253450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:396611f1-c34a-4e5a-8396-03624226b0e0+19:14767:x1876035752799744:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 502us (2079us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127492.552383:0:14761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789127492.552463:0:14767:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df68265d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:396611f1-c34a-4e5a-8396-03624226b0e0:14767:1876035752799744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789127492.552516:0:14767:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df68265d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:396611f1-c34a-4e5a-8396-03624226b0e0:14767:1876035752799872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789127492.552560:0:14767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127492.552768:0:14767:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df786baed80 going to sleep for 11 seconds 00000100:00100000:2.0:1789127492.552935:0:14763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752799872 00000100:00100000:2.0:1789127492.552941:0:14763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752799872 00000100:00100000:2.0:1789127492.553690:0:14763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789127492.553702:0:14763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7af250450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:396611f1-c34a-4e5a-8396-03624226b0e0+19:14767:x1876035752799872:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789127492.554358:0:14763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7af250450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:396611f1-c34a-4e5a-8396-03624226b0e0+19:14767:x1876035752799872:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 657us (1796us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127492.554379:0:14763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789127492.554728:0:14767:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df68265d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:396611f1-c34a-4e5a-8396-03624226b0e0:14767:1876035752799872:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789127492.557996:0:16921:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1789127492.558355:0:14767:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1789127492.558377:0:14767:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789127492.558388:0:14767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff8df7ae729400/0xeeacf7c024301877 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c02430187e expref: -99 pid: 14767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127492.558398:0:14767:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff8df7ae729400/0xeeacf7c024301877 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xeeacf7c02430187e expref: -99 pid: 14767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127492.595489:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789127492.595512:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df682e730c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1876035752800000:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789127492.595577:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127492.595682:0:15459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752800000 00000100:00100000:1.0:1789127492.595690:0:15459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752800000 00000100:00100000:1.0:1789127492.595754:0:15459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789127492.595764:0:15459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6826a4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876035752800000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789127492.595812:0:15459:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1789127492.596231:0:14765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789127492.596559:0:15459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6826a4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876035752800000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 795us (980us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127492.596579:0:15459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789127492.596660:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df682e730c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1876035752800000:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789127493.351638:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127493.351722:0:14761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733930496 00000100:00100000:0.0:1789127493.351731:0:14761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733930496 00000100:00100000:0.0:1789127493.351816:0:14761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 115 00000100:00100000:0.0:1789127493.351827:0:14761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7af253850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24264358-ed5d-48f3-a95a-0a1ee90442a0+11:13951:x1876035733930496:12345-192.168.206.40@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789127493.351844:0:14761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127493.351876:0:14761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df7ae728a00/0xeeacf7c024301885 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7f56 expref: -99 pid: 14761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127493.351917:0:14761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df7ae728a00/0xeeacf7c024301885 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7f56 expref: 12 pid: 14761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127493.351929:0:14761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df7ae728a00/0xeeacf7c024301885 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7f56 expref: 12 pid: 14761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127493.351937:0:14761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7ae728a00, rc 0) 00000100:00100000:0.0:1789127493.351991:0:14761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7af253850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24264358-ed5d-48f3-a95a-0a1ee90442a0+12:13951:x1876035733930496:12345-192.168.206.40@tcp:101:ll_cfg_requeue.0 Request processed in 166us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127493.351998:0:14761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 115 00000100:00100000:0.0:1789127493.355939:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127493.356416:0:14764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733930624 00000100:00100000:3.0:1789127493.356427:0:14764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733930624 00000100:00100000:3.0:1789127493.356482:0:14764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 116 00000100:00100000:3.0:1789127493.356492:0:14764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7af250850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24264358-ed5d-48f3-a95a-0a1ee90442a0+12:13951:x1876035733930624:12345-192.168.206.40@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789127493.356747:0:14764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7af250850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24264358-ed5d-48f3-a95a-0a1ee90442a0+12:13951:x1876035733930624:12345-192.168.206.40@tcp:501:ll_cfg_requeue.0 Request processed in 256us (814us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127493.356756:0:14764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 116 00000100:00100000:2.0:1789127493.363548:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127493.364238:0:14763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733930752 00000100:00100000:3.0:1789127493.364249:0:14763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733930752 00000100:00100000:3.0:1789127493.364306:0:14763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 117 00000100:00100000:3.0:1789127493.364317:0:14763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7af253050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24264358-ed5d-48f3-a95a-0a1ee90442a0+12:13951:x1876035733930752:12345-192.168.206.40@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789127493.364547:0:14763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7af253050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24264358-ed5d-48f3-a95a-0a1ee90442a0+12:13951:x1876035733930752:12345-192.168.206.40@tcp:503:ll_cfg_requeue.0 Request processed in 231us (1006us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127493.364562:0:14763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 117 00000100:00100000:0.0:1789127493.371613:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127493.371684:0:14761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733930880 00000100:00100000:1.0:1789127493.371694:0:14761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733930880 00000100:00100000:1.0:1789127493.371748:0:14761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 118 00000100:00100000:1.0:1789127493.371759:0:14761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7af251050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24264358-ed5d-48f3-a95a-0a1ee90442a0+12:13951:x1876035733930880:12345-192.168.206.40@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789127493.371851:0:14761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127493.371934:0:14761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df6820ad400/0xeeacf7c02430188c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7f5d expref: -99 pid: 14761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127493.371962:0:14761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df6820ad400/0xeeacf7c02430188c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7f5d expref: 13 pid: 14761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127493.371973:0:14761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df6820ad400/0xeeacf7c02430188c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7f5d expref: 13 pid: 14761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127493.371981:0:14761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df6820ad400, rc 0) 00000100:00100000:1.0:1789127493.372033:0:14761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7af251050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24264358-ed5d-48f3-a95a-0a1ee90442a0+13:13951:x1876035733930880:12345-192.168.206.40@tcp:101:ll_cfg_requeue.0 Request processed in 277us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127493.372041:0:14761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 118 00010000:00010000:3.0:1789127493.372399:0:16036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127493.373657:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127493.374713:0:14763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733931008 00000100:00100000:3.0:1789127493.374722:0:14763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733931008 00000100:00100000:3.0:1789127493.374780:0:14763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 119 00000100:00100000:3.0:1789127493.374819:0:14763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7af251850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24264358-ed5d-48f3-a95a-0a1ee90442a0+13:13951:x1876035733931008:12345-192.168.206.40@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789127493.376175:0:14763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7af251850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24264358-ed5d-48f3-a95a-0a1ee90442a0+13:13951:x1876035733931008:12345-192.168.206.40@tcp:501:ll_cfg_requeue.0 Request processed in 1381us (2518us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127493.376187:0:14763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 119 00000100:00100000:1.0:1789127493.391936:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127493.392390:0:14764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733931136 00000100:00100000:0.0:1789127493.392399:0:14764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733931136 00000100:00100000:0.0:1789127493.392457:0:14764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 120 00000100:00100000:0.0:1789127493.392467:0:14764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7af250050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24264358-ed5d-48f3-a95a-0a1ee90442a0+13:13951:x1876035733931136:12345-192.168.206.40@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789127493.392719:0:14764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7af250050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24264358-ed5d-48f3-a95a-0a1ee90442a0+13:13951:x1876035733931136:12345-192.168.206.40@tcp:503:ll_cfg_requeue.0 Request processed in 251us (789us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127493.392727:0:14764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 120 00000100:00100000:2.0:1789127493.870909:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127493.870981:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127493.871008:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127493.871027:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127493.871056:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127493.871089:0:15455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733931520 00000100:00100000:1.0:1789127493.871098:0:15455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733931520 00000100:00100000:1.0:1789127493.871150:0:15455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733931776 00000100:00100000:1.0:1789127493.871154:0:15455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733931776 00000100:00100000:1.0:1789127493.871167:0:15455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733931392 00000100:00100000:1.0:1789127493.871169:0:15455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733931392 00000100:00100000:1.0:1789127493.871187:0:15455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 12 00000100:00100000:1.0:1789127493.871196:0:15455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6826a6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:120b6615-98eb-47cd-be5f-d74b7a580836+5:2347:x1876035733931520:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:1.0:1789127493.871271:0:15455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6826a6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:120b6615-98eb-47cd-be5f-d74b7a580836+5:2347:x1876035733931520:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 75us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127493.871279:0:15455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 12 00000100:00100000:1.0:1789127493.871310:0:15455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 13 00000100:00100000:1.0:1789127493.871316:0:15455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6826a5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a6d4506c-e796-46af-9a51-8e6246e70f67+5:2347:x1876035733931776:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:1.0:1789127493.871338:0:15455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6826a5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a6d4506c-e796-46af-9a51-8e6246e70f67+5:2347:x1876035733931776:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 23us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127493.871344:0:15455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 13 00000100:00100000:1.0:1789127493.871354:0:15455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 14 00000100:00100000:1.0:1789127493.871359:0:15455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df798d96940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:120b6615-98eb-47cd-be5f-d74b7a580836+5:2347:x1876035733931392:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:1.0:1789127493.871375:0:15455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df798d96940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:120b6615-98eb-47cd-be5f-d74b7a580836+5:2347:x1876035733931392:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 16us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127493.871380:0:15455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 14 00000100:00080000:1.0:1789127493.871393:0:14765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789127493.871397:0:14765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789127493.882138:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127493.882181:0:15455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733931904 00000100:00100000:2.0:1789127493.882190:0:15455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733931904 00000100:00100000:2.0:1789127493.882245:0:15455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 15 00000100:00100000:2.0:1789127493.882256:0:15455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df787b8e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a6d4506c-e796-46af-9a51-8e6246e70f67+5:2347:x1876035733931904:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:2.0:1789127493.882335:0:15455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df787b8e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a6d4506c-e796-46af-9a51-8e6246e70f67+5:2347:x1876035733931904:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 81us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127493.882344:0:15455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 15 00000100:00080000:2.0:1789127493.882364:0:14765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789127493.885403:0:14769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733931264 00000100:00100000:0.0:1789127493.885416:0:14769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733931264 00000100:00100000:0.0:1789127493.885508:0:15986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733931648 00000100:00100000:0.0:1789127493.885511:0:15986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733931648 00000100:00100000:0.0:1789127493.885544:0:15986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 25 00000100:00100000:0.0:1789127493.885554:0:15986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6826a5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:120b6615-98eb-47cd-be5f-d74b7a580836+6:2347:x1876035733931264:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:0.0:1789127493.885647:0:15986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6826a5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:120b6615-98eb-47cd-be5f-d74b7a580836+6:2347:x1876035733931264:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 94us (14746us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127493.885655:0:15986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 25 00000100:00100000:0.0:1789127493.885673:0:15986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 26 00000100:00100000:0.0:1789127493.885679:0:15986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df787b8e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a6d4506c-e796-46af-9a51-8e6246e70f67+6:2347:x1876035733931648:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:0.0:1789127493.885703:0:15986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df787b8e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a6d4506c-e796-46af-9a51-8e6246e70f67+6:2347:x1876035733931648:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 24us (14656us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127493.885709:0:15986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 26 00000100:00080000:2.0:1789127493.886109:0:14765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789127494.389486:0:14758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789127494.835485:0:14801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789127495.411052:0:14757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127495.668919:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df787b8de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:396611f1-c34a-4e5a-8396-03624226b0e0:3301:1876035752800128:0@lo:400:kworker.0 00000100:00100000:2.0:1789127495.668999:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127495.669185:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df787b8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752800256:0@lo:400:kworker.0 00000100:00100000:0.0:1789127495.669218:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127495.669266:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df787b8cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1876035752800768:0@lo:400:kworker.0 00000100:00100000:0.0:1789127495.669290:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127495.669314:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789127495.669319:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df787b8c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752800384:0@lo:400:kworker.0 00000100:00100000:0.0:1789127495.669340:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127495.669368:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df787b8f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876035752800512:0@lo:400:kworker.0 00000100:00100000:0.0:1789127495.669390:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127495.669418:0:15986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752800768 00000100:00100000:0.0:1789127495.669424:0:15986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752800768 00000100:00100000:0.0:1789127495.669467:0:15986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752800512 00000100:00100000:0.0:1789127495.669470:0:15986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752800512 00000100:00100000:0.0:1789127495.669488:0:15986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789127495.669496:0:15986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df682c70f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876035752800768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127495.669542:0:15986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df682c70f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876035752800768:12345-0@lo:400:kworker.0 Request processed in 46us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127495.669560:0:15986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789127495.669577:0:15986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789127495.669583:0:15986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df682c71a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876035752800512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127495.669627:0:15986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df682c71a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876035752800512:12345-0@lo:400:kworker.0 Request processed in 45us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127495.669633:0:15986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789127495.669669:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df787b8f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876035752800512:0@lo:400:kworker.0 00000100:00100000:0.0:1789127495.669687:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df787b8cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1876035752800768:0@lo:400:kworker.0 00000100:00100000:0.0:1789127495.669709:0:15455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752800256 00000100:00100000:0.0:1789127495.669712:0:15455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752800256 00000100:00100000:0.0:1789127495.669732:0:15455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752800384 00000100:00100000:0.0:1789127495.669734:0:15455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752800384 00000100:00100000:0.0:1789127495.669744:0:15455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789127495.669749:0:15455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df682c73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1876035752800256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127495.669776:0:15455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df682c73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1876035752800256:12345-0@lo:400:kworker.0 Request processed in 28us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127495.669781:0:15455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789127495.669807:0:15455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789127495.669812:0:15455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df682c71e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1876035752800384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127495.669835:0:15455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df682c71e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1876035752800384:12345-0@lo:400:kworker.0 Request processed in 23us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127495.669840:0:15455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789127495.669860:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df787b8c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752800384:0@lo:400:kworker.0 00000100:00100000:0.0:1789127495.669867:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df787b8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1876035752800256:0@lo:400:kworker.0 00000100:00080000:0.0:1789127495.669893:0:14765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789127495.669897:0:14765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789127495.669899:0:14765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789127495.669938:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df682c703c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1876035752800896:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789127495.669963:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127495.669983:0:15459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752800896 00000100:00100000:1.0:1789127495.669989:0:15459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752800896 00000100:00100000:1.0:1789127495.670024:0:15459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789127495.670031:0:15459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df682c73c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876035752800896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789127495.670067:0:15459:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789127495.670109:0:15459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df682c73c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876035752800896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127495.670116:0:15459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789127495.670147:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df682c703c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1876035752800896:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789127495.671276:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df787b8fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1876035752800640:0@lo:400:kworker.0 00000100:00100000:2.0:1789127495.671317:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127495.672259:0:15986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752800640 00000100:00100000:1.0:1789127495.672269:0:15986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752800640 00000100:00100000:0.0:1789127495.672370:0:14763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752800128 00000100:00100000:0.0:1789127495.672375:0:14763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752800128 00000100:00100000:0.0:1789127495.672415:0:14763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1789127495.672423:0:14763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7af251450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:396611f1-c34a-4e5a-8396-03624226b0e0+19:3301:x1876035752800128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127495.672485:0:14763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7af251450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:396611f1-c34a-4e5a-8396-03624226b0e0+19:3301:x1876035752800128:12345-0@lo:400:kworker.0 Request processed in 63us (3486us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127495.672492:0:14763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1789127495.672539:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df787b8de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:396611f1-c34a-4e5a-8396-03624226b0e0:3301:1876035752800128:0@lo:400:kworker.0 00000100:00100000:1.0:1789127495.672633:0:15986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789127495.672640:0:15986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df787b8e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876035752800640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127495.672673:0:15986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df787b8e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876035752800640:12345-0@lo:400:kworker.0 Request processed in 34us (1357us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127495.672678:0:15986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789127495.673067:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df787b8fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1876035752800640:0@lo:400:kworker.0 00000100:00080000:3.0:1789127495.674101:0:14765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789127495.843231:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127495.843434:0:14769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733932032 00000100:00100000:0.0:1789127495.843442:0:14769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733932032 00000100:00100000:0.0:1789127495.843519:0:14769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 15 00000100:00100000:0.0:1789127495.843529:0:14769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df787b8d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:120b6615-98eb-47cd-be5f-d74b7a580836+6:14608:x1876035733932032:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789127495.843548:0:14769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127495.843565:0:14769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729800/0xeeacf7c024301893 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7f64 expref: -99 pid: 14769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127495.843622:0:14769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c02430189a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127495.843634:0:14769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c02430189a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127495.843656:0:14769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c02430189a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127495.843669:0:14769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c0243018a1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127495.843674:0:14769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c0243018a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127495.843680:0:14769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c0243018a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127495.844147:0:14769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728c00/0xeeacf7c0243018a8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127495.844157:0:14769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728c00/0xeeacf7c0243018a8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127495.844164:0:14769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728c00/0xeeacf7c0243018a8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789127495.844245:0:14769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1789127495.844249:0:14769:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1789127495.844344:0:14769:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728c00/0xeeacf7c0243018a8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127495.844356:0:14769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c02430189a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127495.844361:0:14769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c02430189a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127495.844377:0:14769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c02430189a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127495.844383:0:14769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7ae729c00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:0.0:1789127495.844387:0:14769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c02430189a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127495.844394:0:14769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c02430189a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127495.844405:0:14769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df79f06cb00) 00010000:00010000:0.0:1789127495.844408:0:14769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127495.844412:0:14769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c02430189a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127495.844417:0:14769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c02430189a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127495.844428:0:14769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c0243018a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127495.844433:0:14769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c0243018a1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127495.844438:0:14769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c0243018a1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127495.844442:0:14769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7ae729e00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:0.0:1789127495.844444:0:14769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c0243018a1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127495.844459:0:14769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c0243018a1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127495.844468:0:14769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8df782a68d00) 00010000:00010000:0.0:1789127495.844469:0:14769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127495.844473:0:14769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c0243018a1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127495.844478:0:14769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c0243018a1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127495.844510:0:14769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729800/0xeeacf7c024301893 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7f64 expref: 8 pid: 14769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127495.844523:0:14769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae728c00/0xeeacf7c0243018a8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7f64 expref: 7 pid: 14769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127495.844530:0:14769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8df782a68000) 00010000:00010000:0.0:1789127495.844531:0:14769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789127495.844533:0:14769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7ae728c00, rc 0) 00000100:00100000:0.0:1789127495.844582:0:14769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df787b8d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:120b6615-98eb-47cd-be5f-d74b7a580836+7:14608:x1876035733932032:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 Request processed in 1056us (1361us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127495.844590:0:14769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 15 00000100:00080000:3.0:1789127495.844890:0:14765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789127495.853927:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127495.854080:0:15986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733932288 00000100:00100000:1.0:1789127495.854089:0:15986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733932288 00000100:00100000:1.0:1789127495.854139:0:15986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 16 00000100:00100000:1.0:1789127495.854148:0:15986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df682c712c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:120b6615-98eb-47cd-be5f-d74b7a580836+7:14608:x1876035733932288:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789127495.854167:0:15986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127495.854187:0:15986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df6820ac000/0xeeacf7c0243018af lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7f6b expref: -99 pid: 15986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127495.854251:0:15986:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df6820ada00/0xeeacf7c0243018b6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127495.854265:0:15986:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df6820ada00/0xeeacf7c0243018b6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127495.854277:0:15986:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df6820ada00/0xeeacf7c0243018b6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127495.854330:0:15986:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df6820ad800/0xeeacf7c0243018bd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127495.854337:0:15986:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df6820ad800/0xeeacf7c0243018bd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127495.854359:0:15986:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df6820ad800/0xeeacf7c0243018bd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127495.854811:0:15986:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df6820ac400/0xeeacf7c0243018c4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127495.854820:0:15986:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df6820ac400/0xeeacf7c0243018c4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127495.854827:0:15986:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df6820ac400/0xeeacf7c0243018c4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789127495.854836:0:15986:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1789127495.855052:0:15986:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df6820ada00/0xeeacf7c0243018b6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127495.855060:0:15986:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df6820ada00/0xeeacf7c0243018b6 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127495.855067:0:15986:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df6820ada00/0xeeacf7c0243018b6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127495.855072:0:15986:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df6820ada00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:1.0:1789127495.855076:0:15986:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df6820ada00/0xeeacf7c0243018b6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127495.855082:0:15986:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df6820ada00/0xeeacf7c0243018b6 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127495.855093:0:15986:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8df782a68000) 00010000:00010000:1.0:1789127495.855096:0:15986:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789127495.855105:0:15986:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df6820ada00/0xeeacf7c0243018b6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127495.855111:0:15986:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df6820ada00/0xeeacf7c0243018b6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127495.855122:0:15986:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df6820ad800/0xeeacf7c0243018bd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127495.855128:0:15986:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df6820ad800/0xeeacf7c0243018bd lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127495.855134:0:15986:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df6820ad800/0xeeacf7c0243018bd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127495.855139:0:15986:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df6820ad800 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:1.0:1789127495.855141:0:15986:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df6820ad800/0xeeacf7c0243018bd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127495.855146:0:15986:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df6820ad800/0xeeacf7c0243018bd lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127495.855153:0:15986:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8df798cd5f00) 00010000:00010000:1.0:1789127495.855155:0:15986:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789127495.855157:0:15986:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df6820ad800/0xeeacf7c0243018bd lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127495.855162:0:15986:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df6820ad800/0xeeacf7c0243018bd lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127495.855483:0:15986:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df6820ac000/0xeeacf7c0243018af lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7f6b expref: 10 pid: 15986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127495.855508:0:15986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df6820ac400/0xeeacf7c0243018c4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7f6b expref: 9 pid: 15986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127495.855516:0:15986:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8df798cd5100) 00010000:00010000:1.0:1789127495.855518:0:15986:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789127495.855520:0:15986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df6820ac400, rc 0) 00000100:00100000:1.0:1789127495.855567:0:15986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df682c712c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:120b6615-98eb-47cd-be5f-d74b7a580836+9:14608:x1876035733932288:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 Request processed in 1420us (1648us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1789127495.855574:0:15986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 16 00000100:00100000:2.0:1789127495.881914:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127495.882019:0:14769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733932416 00000100:00100000:0.0:1789127495.882028:0:14769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733932416 00000100:00100000:0.0:1789127495.882098:0:14769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 17 00000100:00100000:0.0:1789127495.882108:0:14769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df787b8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:120b6615-98eb-47cd-be5f-d74b7a580836+9:14608:x1876035733932416:12345-192.168.206.40@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1789127495.882236:0:14769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df787b8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:120b6615-98eb-47cd-be5f-d74b7a580836+9:14608:x1876035733932416:12345-192.168.206.40@tcp:59:lhsmtool_posix.0 Request processed in 129us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127495.882245:0:14769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 17 00000100:00100000:2.0:1789127495.938168:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127495.938334:0:15986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733932544 00000100:00100000:1.0:1789127495.938347:0:15986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733932544 00000100:00100000:1.0:1789127495.938424:0:15986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 18 00000100:00100000:1.0:1789127495.938448:0:15986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df787b8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:120b6615-98eb-47cd-be5f-d74b7a580836+9:14614:x1876035733932544:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:1.0:1789127495.938474:0:15986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127495.938501:0:15986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df6820ac000/0xeeacf7c0243018d2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7f72 expref: -99 pid: 15986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127495.938589:0:15986:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df6820ad800/0xeeacf7c0243018d9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127495.938611:0:15986:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df6820ad800/0xeeacf7c0243018d9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127495.938624:0:15986:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df6820ad800/0xeeacf7c0243018d9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127495.938642:0:15986:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df6820ada00/0xeeacf7c0243018e0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127495.938663:0:15986:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df6820ada00/0xeeacf7c0243018e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127495.938671:0:15986:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df6820ada00/0xeeacf7c0243018e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127495.939023:0:15986:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df6820ad800/0xeeacf7c0243018d9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127495.939032:0:15986:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df6820ad800/0xeeacf7c0243018d9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127495.939049:0:15986:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df6820ad800/0xeeacf7c0243018d9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127495.939055:0:15986:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df6820ad800 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:1.0:1789127495.939060:0:15986:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df6820ad800/0xeeacf7c0243018d9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127495.939068:0:15986:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df6820ad800/0xeeacf7c0243018d9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127495.939082:0:15986:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df79f06cb00) 00010000:00010000:1.0:1789127495.939086:0:15986:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789127495.939092:0:15986:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df6820ad800/0xeeacf7c0243018d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127495.939098:0:15986:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df6820ad800/0xeeacf7c0243018d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127495.939111:0:15986:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df6820ada00/0xeeacf7c0243018e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127495.939124:0:15986:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df6820ada00/0xeeacf7c0243018e0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127495.939130:0:15986:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df6820ada00/0xeeacf7c0243018e0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127495.939135:0:15986:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df6820ada00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:1.0:1789127495.939138:0:15986:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df6820ada00/0xeeacf7c0243018e0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127495.939145:0:15986:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df6820ada00/0xeeacf7c0243018e0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127495.939154:0:15986:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8df798cd5f00) 00010000:00010000:1.0:1789127495.939157:0:15986:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789127495.939160:0:15986:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df6820ada00/0xeeacf7c0243018e0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127495.939167:0:15986:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df6820ada00/0xeeacf7c0243018e0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127495.939209:0:15986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df6820ac000/0xeeacf7c0243018d2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7f72 expref: 10 pid: 15986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127495.939220:0:15986:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df79f06cb00) 00010000:00010000:1.0:1789127495.939222:0:15986:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789127495.939225:0:15986:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df6820ac000/0xeeacf7c0243018d2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7f72 expref: 10 pid: 15986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127495.939245:0:15986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df6820ac000, rc 0) 00000100:00100000:1.0:1789127495.939319:0:15986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df787b8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:120b6615-98eb-47cd-be5f-d74b7a580836+9:14614:x1876035733932544:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 874us (1163us total) trans 0 rc 301/301 00000100:00100000:1.0:1789127495.939328:0:15986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 18 00000100:00100000:2.0:1789127495.948529:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127495.948643:0:14778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733932672 00000100:00100000:1.0:1789127495.948655:0:14778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733932672 00000100:00100000:1.0:1789127495.948735:0:14778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 0 00000100:00100000:1.0:1789127495.948748:0:14778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df787b8d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:120b6615-98eb-47cd-be5f-d74b7a580836+9:14614:x1876035733932672:12345-192.168.206.40@tcp:700:lfs.0 00000100:00100000:1.0:1789127495.948899:0:14778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df787b8d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:120b6615-98eb-47cd-be5f-d74b7a580836+9:14614:x1876035733932672:12345-192.168.206.40@tcp:700:lfs.0 Request processed in 152us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127495.948908:0:14778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 0 00000100:00100000:2.0:1789127495.955444:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127495.955766:0:14769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733932928 00000100:00100000:0.0:1789127495.955779:0:14769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733932928 00000100:00100000:0.0:1789127495.955904:0:14769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 19 00000100:00100000:0.0:1789127495.955915:0:14769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df787b8f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:120b6615-98eb-47cd-be5f-d74b7a580836+9:14614:x1876035733932928:12345-192.168.206.40@tcp:36:lfs.0 00010000:00010000:0.0:1789127495.955996:0:14769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789127495.956032:0:14769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024301815 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7eed expref: 9 pid: 14770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127495.956065:0:14769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df79f06cb00) 00010000:00010000:0.0:1789127495.956071:0:14769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789127495.956428:0:14769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729800/0xeeacf7c0243018e7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127495.956445:0:14769:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729000/0xeeacf7c02430184d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7f4f expref: 5 pid: 14770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127495.956456:0:14769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729800/0xeeacf7c0243018e7 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127495.956704:0:14769:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729000/0xeeacf7c02430184d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7f4f expref: 5 pid: 14770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127495.956724:0:14769:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729000/0xeeacf7c02430184d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7f4f expref: 5 pid: 14770 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127495.956760:0:14769:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df682c721c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14769:1876035752801024:192.168.206.40@tcp:104: 00000100:00100000:0.0:1789127495.957275:0:14769:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7b46bee40 going to sleep for 11 seconds 00000100:00100000:2.0:1789127495.960647:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127495.960835:0:14754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733933056 00000100:00100000:1.0:1789127495.960848:0:14754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733933056 00010000:00010000:1.0:1789127495.960915:0:14754:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729000/0xeeacf7c02430184d lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7f4f expref: 6 pid: 14770 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127495.960969:0:14754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 9 00000100:00100000:1.0:1789127495.960981:0:14754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df787b8cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a6d4506c-e796-46af-9a51-8e6246e70f67+6:2349:x1876035733933056:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789127495.961001:0:14754:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789127495.961010:0:14754:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729000/0xeeacf7c02430184d lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7f4f expref: 6 pid: 14770 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127495.961027:0:14754:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729000/0xeeacf7c02430184d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7f4f expref: 6 pid: 14770 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127495.961092:0:14754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df79f06cb00) 00010000:00010000:1.0:1789127495.961099:0:14754:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729800/0xeeacf7c0243018e7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127495.961109:0:14754:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729800/0xeeacf7c0243018e7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127495.961118:0:14754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729800/0xeeacf7c0243018e7 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127495.961145:0:14754:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789127495.961214:0:14754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df787b8cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a6d4506c-e796-46af-9a51-8e6246e70f67+6:2349:x1876035733933056:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 234us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127495.961223:0:14754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 9 00000100:00080000:3.0:1789127495.961516:0:14765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789127495.962961:0:14769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729000/0xeeacf7c02430184d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7f4f expref: 5 pid: 14770 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127495.962999:0:14769:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df682c721c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14769:1876035752801024:192.168.206.40@tcp:104: 00010000:00010000:0.0:1789127495.963048:0:14769:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729800/0xeeacf7c0243018e7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127495.963059:0:14769:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729800/0xeeacf7c0243018e7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127495.963066:0:14769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729800/0xeeacf7c0243018e7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127495.963102:0:14769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c0243018ee lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127495.963116:0:14769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c0243018ee lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127495.963126:0:14769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c0243018ee lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789127495.969441:0:14769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1789127495.969466:0:14769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729800/0xeeacf7c0243018e7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127495.969479:0:14769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729800/0xeeacf7c0243018e7 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127495.969497:0:14769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729800/0xeeacf7c0243018e7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127495.969504:0:14769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7ae729800 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:0.0:1789127495.969509:0:14769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729800/0xeeacf7c0243018e7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127495.969518:0:14769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729800/0xeeacf7c0243018e7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127495.969538:0:14769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df79f06cb00) 00010000:00010000:0.0:1789127495.969542:0:14769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127495.969548:0:14769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729800/0xeeacf7c0243018e7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127495.969555:0:14769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729800/0xeeacf7c0243018e7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789127495.969581:0:14769:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000fc338067 reply state 000000007bc6dac7 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c0243018ee lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127495.969591:0:14769:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789127495.969722:0:14769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df787b8f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:120b6615-98eb-47cd-be5f-d74b7a580836+10:14614:x1876035733932928:12345-192.168.206.40@tcp:36:lfs.0 Request processed in 13803us (14287us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1789127495.969732:0:14769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 19 00010000:00010000:3.0:1789127495.974397:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c0243018ee lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127495.974420:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c0243018ee lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127495.974429:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c0243018ee lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127495.974436:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7ae729e00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:3.0:1789127495.974441:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c0243018ee lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127495.974450:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c0243018ee lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127495.974568:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8df782a68d00) 00010000:00010000:3.0:1789127495.974573:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127495.974580:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c0243018ee lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127495.974588:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c0243018ee lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127496.133285:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127496.133518:0:15986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733933184 00000100:00100000:0.0:1789127496.133531:0:15986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733933184 00000100:00100000:0.0:1789127496.133661:0:15986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 20 00000100:00100000:0.0:1789127496.133684:0:15986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df682e73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:120b6615-98eb-47cd-be5f-d74b7a580836+9:14622:x1876035733933184:12345-192.168.206.40@tcp:101:lctl.0 00010000:00010000:0.0:1789127496.133737:0:15986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127496.133769:0:15986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729800/0xeeacf7c0243018f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7f79 expref: -99 pid: 15986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127496.133906:0:15986:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729000/0xeeacf7c0243018fc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127496.133923:0:15986:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729000/0xeeacf7c0243018fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127496.133936:0:15986:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729000/0xeeacf7c0243018fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789127496.134130:0:15986:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1789127496.134136:0:15986:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:0.0:1789127496.134191:0:15986:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729000/0xeeacf7c0243018fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127496.134223:0:15986:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729800/0xeeacf7c0243018f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7f79 expref: 11 pid: 15986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127496.134248:0:15986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729000/0xeeacf7c0243018fc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7f79 expref: 10 pid: 15986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127496.134258:0:15986:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df782a68300) 00010000:00010000:0.0:1789127496.134261:0:15986:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789127496.134266:0:15986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7ae729000, rc 0) 00000100:00100000:0.0:1789127496.134351:0:15986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df682e73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:120b6615-98eb-47cd-be5f-d74b7a580836+10:14622:x1876035733933184:12345-192.168.206.40@tcp:101:lctl.0 Request processed in 670us (1080us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127496.134359:0:15986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 20 00000100:00100000:2.0:1789127496.165762:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127496.166297:0:14771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733933312 00000100:00100000:1.0:1789127496.166313:0:14771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733933312 00000100:00100000:1.0:1789127496.166387:0:14771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 21 00000100:00100000:1.0:1789127496.166399:0:14771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df787b8da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a6d4506c-e796-46af-9a51-8e6246e70f67+5:14623:x1876035733933312:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:1.0:1789127496.166661:0:14771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127496.166691:0:14771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df6820ada00/0xeeacf7c024301903 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7f80 expref: -99 pid: 14771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127496.166779:0:14771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df6820ad800/0xeeacf7c02430190a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127496.166843:0:14771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df6820ad800/0xeeacf7c02430190a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127496.166879:0:14771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df6820ad800/0xeeacf7c02430190a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789127496.166956:0:14771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1789127496.166961:0:14771:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:1.0:1789127496.167255:0:14771:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df6820ad800/0xeeacf7c02430190a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127496.167291:0:14771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df6820ada00/0xeeacf7c024301903 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7f80 expref: 7 pid: 14771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127496.167314:0:14771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df6820ad800/0xeeacf7c02430190a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7f80 expref: 6 pid: 14771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127496.167324:0:14771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df782a68300) 00010000:00010000:1.0:1789127496.167327:0:14771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789127496.167332:0:14771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df6820ad800, rc 0) 00000100:00100000:1.0:1789127496.167523:0:14771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df787b8da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a6d4506c-e796-46af-9a51-8e6246e70f67+6:14623:x1876035733933312:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 1124us (1913us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127496.167544:0:14771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 21 00000100:00100000:3.0:1789127496.174152:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127496.174235:0:14770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733933440 00000100:00100000:2.0:1789127496.174249:0:14770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733933440 00000100:00100000:2.0:1789127496.174465:0:14770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 22 00000100:00100000:2.0:1789127496.174479:0:14770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df68265d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a6d4506c-e796-46af-9a51-8e6246e70f67+6:14623:x1876035733933440:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:2.0:1789127496.174505:0:14770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127496.174537:0:14770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6a00/0xeeacf7c024301911 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7f87 expref: -99 pid: 14770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127496.174616:0:14770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6400/0xeeacf7c024301918 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127496.174634:0:14770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6400/0xeeacf7c024301918 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127496.174649:0:14770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6400/0xeeacf7c024301918 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127496.174666:0:14770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6000/0xeeacf7c02430191f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127496.174674:0:14770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6000/0xeeacf7c02430191f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127496.174700:0:14770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6000/0xeeacf7c02430191f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127496.176022:0:14770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6600/0xeeacf7c024301926 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127496.176059:0:14770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6600/0xeeacf7c024301926 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127496.176072:0:14770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6600/0xeeacf7c024301926 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789127496.176252:0:14770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1789127496.176259:0:14770:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789127496.176359:0:14770:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6600/0xeeacf7c024301926 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127496.176374:0:14770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6400/0xeeacf7c024301918 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127496.176381:0:14770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6400/0xeeacf7c024301918 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127496.176388:0:14770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6400/0xeeacf7c024301918 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127496.176394:0:14770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7aeab6400 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:2.0:1789127496.176398:0:14770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6400/0xeeacf7c024301918 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127496.176405:0:14770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6400/0xeeacf7c024301918 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127496.176498:0:14770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df782a68300) 00010000:00010000:2.0:1789127496.176501:0:14770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789127496.176505:0:14770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6400/0xeeacf7c024301918 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127496.176511:0:14770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6400/0xeeacf7c024301918 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127496.176526:0:14770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6000/0xeeacf7c02430191f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127496.176531:0:14770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6000/0xeeacf7c02430191f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127496.176537:0:14770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6000/0xeeacf7c02430191f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127496.176541:0:14770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7aeab6000 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:2.0:1789127496.176544:0:14770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6000/0xeeacf7c02430191f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127496.176550:0:14770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6000/0xeeacf7c02430191f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127496.176557:0:14770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8df7906f6d00) 00010000:00010000:2.0:1789127496.176559:0:14770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789127496.176562:0:14770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6000/0xeeacf7c02430191f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127496.176566:0:14770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6000/0xeeacf7c02430191f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127496.176617:0:14770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6a00/0xeeacf7c024301911 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7f87 expref: 8 pid: 14770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127496.176631:0:14770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6600/0xeeacf7c024301926 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7f87 expref: 7 pid: 14770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127496.176637:0:14770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8df7906f6700) 00010000:00010000:2.0:1789127496.176640:0:14770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789127496.176642:0:14770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7aeab6600, rc 0) 00000100:00100000:2.0:1789127496.176715:0:14770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df68265d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a6d4506c-e796-46af-9a51-8e6246e70f67+7:14623:x1876035733933440:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 2239us (2577us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127496.176724:0:14770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 22 00000100:00100000:2.0:1789127496.180991:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127496.181879:0:14769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733933696 00000100:00100000:0.0:1789127496.181891:0:14769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733933696 00000100:00100000:0.0:1789127496.181967:0:14769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 23 00000100:00100000:0.0:1789127496.181977:0:14769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df787b8ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a6d4506c-e796-46af-9a51-8e6246e70f67+7:14623:x1876035733933696:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:0.0:1789127496.181997:0:14769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127496.182017:0:14769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c02430192d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7f8e expref: -99 pid: 14769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789127496.182134:0:14769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1789127496.182260:0:14769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c02430192d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7f8e expref: 9 pid: 14769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127496.182962:0:14769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df782a68300) 00010000:00010000:0.0:1789127496.182968:0:14769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789127496.182975:0:14769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c02430192d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7f8e expref: 9 pid: 14769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127496.182990:0:14769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7ae729c00, rc 0) 00000100:00100000:0.0:1789127496.183055:0:14769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df787b8ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a6d4506c-e796-46af-9a51-8e6246e70f67+8:14623:x1876035733933696:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 1080us (2072us total) trans 8589934595 rc 301/301 00000100:00100000:0.0:1789127496.183064:0:14769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 23 00000100:00100000:0.0:1789127496.206216:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127496.206324:0:15986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733933952 00000100:00100000:2.0:1789127496.206334:0:15986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733933952 00000100:00100000:2.0:1789127496.206393:0:15986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 24 00000100:00100000:2.0:1789127496.206403:0:15986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df682c721c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a6d4506c-e796-46af-9a51-8e6246e70f67+8:14623:x1876035733933952:12345-192.168.206.40@tcp:36:lfs.0 00010000:00010000:2.0:1789127496.206452:0:15986:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789127496.206478:0:15986:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6600/0xeeacf7c024301926 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7f87 expref: 8 pid: 14770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127496.206495:0:15986:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8df7906f6700) 00010000:00010000:2.0:1789127496.206505:0:15986:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789127496.206528:0:15986:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6a00/0xeeacf7c02430193b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127496.206541:0:15986:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6a00/0xeeacf7c02430193b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127496.206564:0:15986:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6a00/0xeeacf7c02430193b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789127496.206772:0:15986:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000002c03f0f6 reply state 00000000447e7a12 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6a00/0xeeacf7c02430193b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127496.206782:0:15986:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789127496.206843:0:15986:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:2.0:1789127496.206923:0:15986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df682c721c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a6d4506c-e796-46af-9a51-8e6246e70f67+9:14623:x1876035733933952:12345-192.168.206.40@tcp:36:lfs.0 Request processed in 521us (716us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1789127496.206930:0:15986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 24 00010000:00010000:2.0:1789127496.214944:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6a00/0xeeacf7c02430193b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127496.214960:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6a00/0xeeacf7c02430193b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127496.214967:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6a00/0xeeacf7c02430193b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127496.214973:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7aeab6a00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:2.0:1789127496.214977:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6a00/0xeeacf7c02430193b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127496.214984:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6a00/0xeeacf7c02430193b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127496.214999:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8df7906f6d00) 00010000:00010000:2.0:1789127496.215002:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1789127496.215007:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6a00/0xeeacf7c02430193b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127496.215028:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6a00/0xeeacf7c02430193b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127496.215265:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127496.215424:0:14772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733934208 00000100:00100000:1.0:1789127496.215433:0:14772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733934208 00000100:00100000:1.0:1789127496.215527:0:14772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 2 00000100:00100000:1.0:1789127496.215537:0:14772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df68265da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a6d4506c-e796-46af-9a51-8e6246e70f67+8:14623:x1876035733934208:12345-192.168.206.40@tcp:35:lfs.0 00000100:00100000:1.0:1789127496.215808:0:14772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df68265da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a6d4506c-e796-46af-9a51-8e6246e70f67+9:14623:x1876035733934208:12345-192.168.206.40@tcp:35:lfs.0 Request processed in 253us (528us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1789127496.215817:0:14772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 2 00000100:00100000:1.0:1789127496.218835:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127496.219014:0:14771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733934464 00000100:00100000:3.0:1789127496.219024:0:14771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733934464 00000100:00100000:3.0:1789127496.219090:0:14771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 25 00000100:00100000:3.0:1789127496.219100:0:14771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df682e71680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a6d4506c-e796-46af-9a51-8e6246e70f67+9:14623:x1876035733934464:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:3.0:1789127496.219122:0:14771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127496.219152:0:14771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96c00/0xeeacf7c024301942 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7f95 expref: -99 pid: 14771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127496.219223:0:14771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97000/0xeeacf7c024301949 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127496.219239:0:14771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97000/0xeeacf7c024301949 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127496.219251:0:14771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97000/0xeeacf7c024301949 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127496.219265:0:14771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024301950 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127496.219302:0:14771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024301950 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127496.219310:0:14771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024301950 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789127496.219430:0:14771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1789127496.219519:0:14771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97000/0xeeacf7c024301949 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127496.219527:0:14771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97000/0xeeacf7c024301949 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127496.219532:0:14771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97000/0xeeacf7c024301949 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127496.219538:0:14771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd97000 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:3.0:1789127496.219542:0:14771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97000/0xeeacf7c024301949 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127496.219549:0:14771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97000/0xeeacf7c024301949 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127496.219561:0:14771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df782a68300) 00010000:00010000:3.0:1789127496.219563:0:14771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127496.219568:0:14771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97000/0xeeacf7c024301949 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127496.219574:0:14771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97000/0xeeacf7c024301949 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127496.219596:0:14771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024301950 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127496.219602:0:14771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024301950 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127496.219608:0:14771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024301950 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127496.219613:0:14771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd96000 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:3.0:1789127496.219616:0:14771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024301950 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127496.219622:0:14771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024301950 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127496.219629:0:14771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8df79f06c000) 00010000:00010000:3.0:1789127496.219631:0:14771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127496.219634:0:14771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024301950 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127496.219640:0:14771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024301950 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127496.220063:0:14771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96c00/0xeeacf7c024301942 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7f95 expref: 11 pid: 14771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127496.220074:0:14771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df782a68300) 00010000:00010000:3.0:1789127496.220077:0:14771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789127496.220087:0:14771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96c00/0xeeacf7c024301942 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7f95 expref: 11 pid: 14771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127496.220096:0:14771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7bbd96c00, rc 0) 00000100:00100000:3.0:1789127496.220299:0:14771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df682e71680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a6d4506c-e796-46af-9a51-8e6246e70f67+10:14623:x1876035733934464:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 1199us (1469us total) trans 8589934598 rc 301/301 00000100:00100000:3.0:1789127496.220308:0:14771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 25 00000100:00100000:1.0:1789127496.230615:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127496.230723:0:15986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733934592 00000100:00100000:2.0:1789127496.230731:0:15986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733934592 00000100:00100000:2.0:1789127496.230817:0:15986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 26 00000100:00100000:2.0:1789127496.230833:0:15986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df682e70f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a6d4506c-e796-46af-9a51-8e6246e70f67+10:14623:x1876035733934592:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:2.0:1789127496.230858:0:15986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127496.230879:0:15986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6a00/0xeeacf7c02430195e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7f9c expref: -99 pid: 15986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127496.230953:0:15986:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6000/0xeeacf7c024301965 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127496.230965:0:15986:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6000/0xeeacf7c024301965 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127496.230975:0:15986:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6000/0xeeacf7c024301965 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789127496.231017:0:15986:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1789127496.231020:0:15986:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789127496.231050:0:15986:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6000/0xeeacf7c024301965 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127496.231074:0:15986:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6a00/0xeeacf7c02430195e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7f9c expref: 12 pid: 15986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127496.231089:0:15986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6000/0xeeacf7c024301965 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7f9c expref: 11 pid: 15986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127496.231110:0:15986:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8df7906f6d00) 00010000:00010000:2.0:1789127496.231112:0:15986:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789127496.231116:0:15986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7aeab6000, rc 0) 00000100:00100000:2.0:1789127496.231173:0:15986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df682e70f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a6d4506c-e796-46af-9a51-8e6246e70f67+11:14623:x1876035733934592:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 347us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127496.231181:0:15986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 26 00000100:00100000:2.0:1789127496.237931:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127496.238028:0:14773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733934720 00000100:00100000:3.0:1789127496.238052:0:14773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733934720 00000100:00100000:3.0:1789127496.238117:0:14773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 3 00000100:00100000:3.0:1789127496.238128:0:14773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df787b8fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a6d4506c-e796-46af-9a51-8e6246e70f67+11:14623:x1876035733934720:12345-192.168.206.40@tcp:37:lfs.0 00000100:00100000:3.0:1789127496.242341:0:14773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df787b8fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a6d4506c-e796-46af-9a51-8e6246e70f67+11:14623:x1876035733934720:12345-192.168.206.40@tcp:37:lfs.0 Request processed in 4198us (4402us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127496.242358:0:14773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 3 00000100:00100000:1.0:1789127496.246164:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127496.246333:0:14772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733934976 00000100:00100000:2.0:1789127496.246346:0:14772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733934976 00000100:00100000:2.0:1789127496.246418:0:14772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 4 00000100:00100000:2.0:1789127496.246432:0:14772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aea71450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a6d4506c-e796-46af-9a51-8e6246e70f67+11:14623:x1876035733934976:12345-192.168.206.40@tcp:35:lfs.0 00000100:00100000:2.0:1789127496.246834:0:14772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aea71450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a6d4506c-e796-46af-9a51-8e6246e70f67+12:14623:x1876035733934976:12345-192.168.206.40@tcp:35:lfs.0 Request processed in 362us (640us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1789127496.246844:0:14772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 4 00000100:00100000:2.0:1789127496.289501:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127496.289700:0:14769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733935104 00000100:00100000:0.0:1789127496.289713:0:14769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733935104 00000100:00100000:3.0:1789127496.289993:0:14771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 27 00000100:00100000:3.0:1789127496.290008:0:14771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df787b8fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:120b6615-98eb-47cd-be5f-d74b7a580836+10:14629:x1876035733935104:12345-192.168.206.40@tcp:101:bash.0 00010000:00010000:3.0:1789127496.290052:0:14771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127496.290080:0:14771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96c00/0xeeacf7c02430196c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7fa3 expref: -99 pid: 14771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127496.290227:0:14771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024301973 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127496.290245:0:14771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024301973 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127496.290258:0:14771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024301973 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127496.290297:0:14771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97000/0xeeacf7c02430197a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127496.290304:0:14771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97000/0xeeacf7c02430197a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127496.290310:0:14771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97000/0xeeacf7c02430197a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127496.290443:0:14771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97a00/0xeeacf7c024301981 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127496.290452:0:14771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97a00/0xeeacf7c024301981 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127496.290460:0:14771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97a00/0xeeacf7c024301981 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789127496.290614:0:14771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:3.0:1789127496.290619:0:14771:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789127496.290674:0:14771:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97a00/0xeeacf7c024301981 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127496.290690:0:14771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024301973 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127496.290697:0:14771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024301973 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127496.290704:0:14771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024301973 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127496.290721:0:14771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd96000 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:3.0:1789127496.290726:0:14771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024301973 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127496.290735:0:14771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024301973 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127496.290760:0:14771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df782a68300) 00010000:00010000:3.0:1789127496.290764:0:14771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127496.290770:0:14771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024301973 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127496.290778:0:14771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024301973 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127496.290830:0:14771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97000/0xeeacf7c02430197a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127496.290837:0:14771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97000/0xeeacf7c02430197a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127496.290843:0:14771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97000/0xeeacf7c02430197a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127496.290848:0:14771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd97000 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:3.0:1789127496.290850:0:14771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97000/0xeeacf7c02430197a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127496.290856:0:14771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97000/0xeeacf7c02430197a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127496.291085:0:14771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8df79f06c000) 00010000:00010000:3.0:1789127496.291088:0:14771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127496.291092:0:14771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97000/0xeeacf7c02430197a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127496.291157:0:14771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97000/0xeeacf7c02430197a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127496.291204:0:14771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96c00/0xeeacf7c02430196c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7fa3 expref: 12 pid: 14771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127496.291219:0:14771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97a00/0xeeacf7c024301981 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7fa3 expref: 11 pid: 14771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127496.291227:0:14771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8df7906f6d00) 00010000:00010000:3.0:1789127496.291230:0:14771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789127496.291233:0:14771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7bbd97a00, rc 0) 00000100:00100000:3.0:1789127496.291440:0:14771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df787b8fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:120b6615-98eb-47cd-be5f-d74b7a580836+11:14629:x1876035733935104:12345-192.168.206.40@tcp:101:bash.0 Request processed in 1434us (1957us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127496.291450:0:14771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 27 00000100:00100000:1.0:1789127496.294613:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127496.294668:0:14770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733935360 00000100:00100000:3.0:1789127496.294680:0:14770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733935360 00000100:00100000:3.0:1789127496.294835:0:14770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 28 00000100:00100000:3.0:1789127496.294846:0:14770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df682e71a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:120b6615-98eb-47cd-be5f-d74b7a580836+11:14629:x1876035733935360:12345-192.168.206.40@tcp:101:bash.0 00010000:00010000:3.0:1789127496.294872:0:14770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127496.294895:0:14770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96e00/0xeeacf7c024301988 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7faa expref: -99 pid: 14770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127496.295103:0:14770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97400/0xeeacf7c02430198f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127496.295120:0:14770:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6000/0xeeacf7c024301965 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7f9c expref: 11 pid: 15986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127496.295130:0:14770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97400/0xeeacf7c02430198f lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127496.295171:0:14770:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6000/0xeeacf7c024301965 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7f9c expref: 11 pid: 15986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127496.295186:0:14770:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6000/0xeeacf7c024301965 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7f9c expref: 11 pid: 15986 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127496.295201:0:14770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df68265d680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14770:1876035752801152:192.168.206.40@tcp:104: 00000100:00100000:3.0:1789127496.295319:0:14770:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7a1fcd600 going to sleep for 11 seconds 00000100:00100000:3.0:1789127496.297568:0:14770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df68265d680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14770:1876035752801152:192.168.206.40@tcp:104: 00010000:00010000:3.0:1789127496.297601:0:14770:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97400/0xeeacf7c02430198f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127496.299060:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127496.299157:0:14755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733935488 00000100:00100000:2.0:1789127496.299167:0:14755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733935488 00010000:00010000:2.0:1789127496.299210:0:14755:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6000/0xeeacf7c024301965 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7f9c expref: 12 pid: 15986 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127496.299262:0:14755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 10 00000100:00100000:2.0:1789127496.299273:0:14755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df682e730c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a6d4506c-e796-46af-9a51-8e6246e70f67+12:2348:x1876035733935488:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789127496.299291:0:14755:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789127496.299299:0:14755:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6000/0xeeacf7c024301965 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7f9c expref: 12 pid: 15986 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127496.299339:0:14755:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6000/0xeeacf7c024301965 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7f9c expref: 12 pid: 15986 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127496.299369:0:14755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6000/0xeeacf7c024301965 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7f9c expref: 12 pid: 15986 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127496.299388:0:14755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8df7906f6d00) 00010000:00010000:2.0:1789127496.299393:0:14755:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97400/0xeeacf7c02430198f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127496.299405:0:14755:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97400/0xeeacf7c02430198f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127496.299414:0:14755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97400/0xeeacf7c02430198f lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127496.299447:0:14755:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789127496.299511:0:14770:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97400/0xeeacf7c02430198f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127496.299522:0:14770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97400/0xeeacf7c02430198f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127496.299528:0:14755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df682e730c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a6d4506c-e796-46af-9a51-8e6246e70f67+11:2348:x1876035733935488:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 253us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127496.299540:0:14755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 10 00010000:00010000:3.0:1789127496.299554:0:14770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96c00/0xeeacf7c024301996 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127496.299573:0:14770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96c00/0xeeacf7c024301996 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127496.299582:0:14770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96c00/0xeeacf7c024301996 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127496.301359:0:14770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97000/0xeeacf7c02430199d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127496.301382:0:14770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97000/0xeeacf7c02430199d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127496.301393:0:14770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97000/0xeeacf7c02430199d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789127496.301410:0:14770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789127496.301456:0:14770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97400/0xeeacf7c02430198f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127496.301463:0:14770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97400/0xeeacf7c02430198f lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127496.301470:0:14770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97400/0xeeacf7c02430198f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127496.301475:0:14770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd97400 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:3.0:1789127496.301479:0:14770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97400/0xeeacf7c02430198f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127496.301486:0:14770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97400/0xeeacf7c02430198f lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127496.301515:0:14770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8df7906f6d00) 00010000:00010000:3.0:1789127496.301519:0:14770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127496.301523:0:14770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97400/0xeeacf7c02430198f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127496.301529:0:14770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97400/0xeeacf7c02430198f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789127496.301546:0:14770:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000896552ef reply state 00000000e925c524 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96c00/0xeeacf7c024301996 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127496.301553:0:14770:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789127496.301598:0:14770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96e00/0xeeacf7c024301988 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7faa expref: 14 pid: 14770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127496.301612:0:14770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97000/0xeeacf7c02430199d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7faa expref: 13 pid: 14770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127496.301619:0:14770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8df79f06c900) 00010000:00010000:3.0:1789127496.301621:0:14770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1789127496.301623:0:14770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7bbd97000, rc 0) 00000100:00100000:3.0:1789127496.301706:0:14770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df682e71a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:120b6615-98eb-47cd-be5f-d74b7a580836+14:14629:x1876035733935360:12345-192.168.206.40@tcp:101:bash.0 Request processed in 6861us (7107us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1789127496.301715:0:14770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 28 00010000:00010000:3.0:1789127496.307664:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96c00/0xeeacf7c024301996 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127496.307679:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96c00/0xeeacf7c024301996 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127496.307703:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96c00/0xeeacf7c024301996 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127496.307720:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd96c00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:3.0:1789127496.307725:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96c00/0xeeacf7c024301996 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127496.307733:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96c00/0xeeacf7c024301996 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127496.307756:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8df79f06c000) 00010000:00010000:3.0:1789127496.307759:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127496.307764:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96c00/0xeeacf7c024301996 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127496.307769:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96c00/0xeeacf7c024301996 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127496.320429:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127496.320579:0:14769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733935616 00000100:00100000:2.0:1789127496.320590:0:14769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733935616 00000100:00100000:2.0:1789127496.320710:0:14769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 29 00000100:00100000:2.0:1789127496.320722:0:14769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df682c703c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:120b6615-98eb-47cd-be5f-d74b7a580836+13:14629:x1876035733935616:12345-192.168.206.40@tcp:101:bash.0 00010000:00010000:2.0:1789127496.320751:0:14769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127496.320775:0:14769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6000/0xeeacf7c0243019ab lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7fb1 expref: -99 pid: 14769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127496.320923:0:14769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6400/0xeeacf7c0243019b2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127496.320940:0:14769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6400/0xeeacf7c0243019b2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127496.320952:0:14769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6400/0xeeacf7c0243019b2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789127496.320998:0:14769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789127496.321003:0:14769:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789127496.321026:0:14769:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6400/0xeeacf7c0243019b2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127496.321058:0:14769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6400/0xeeacf7c0243019b2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127496.321085:0:14769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6000/0xeeacf7c0243019ab lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7fb1 expref: 15 pid: 14769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127496.321105:0:14769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6400/0xeeacf7c0243019b2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7fb1 expref: 14 pid: 14769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127496.321114:0:14769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8df79f06c900) 00010000:00010000:2.0:1789127496.321118:0:14769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789127496.321122:0:14769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7aeab6400, rc 0) 00000100:00100000:2.0:1789127496.321196:0:14769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df682c703c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:120b6615-98eb-47cd-be5f-d74b7a580836+14:14629:x1876035733935616:12345-192.168.206.40@tcp:101:bash.0 Request processed in 477us (781us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127496.321205:0:14769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 29 00000100:00100000:1.0:1789127496.326226:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127496.326381:0:14772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733935872 00000100:00100000:3.0:1789127496.326393:0:14772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733935872 00000100:00100000:3.0:1789127496.326519:0:14772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 5 00000100:00100000:3.0:1789127496.326530:0:14772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df682e703c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:120b6615-98eb-47cd-be5f-d74b7a580836+14:14629:x1876035733935872:12345-192.168.206.40@tcp:35:bash.0 00000100:00100000:3.0:1789127496.327132:0:14772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df682e703c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:120b6615-98eb-47cd-be5f-d74b7a580836+15:14629:x1876035733935872:12345-192.168.206.40@tcp:35:bash.0 Request processed in 600us (916us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1789127496.327142:0:14772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 5 00000100:00100000:1.0:1789127496.382391:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127496.382549:0:15986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733936128 00000100:00100000:2.0:1789127496.382563:0:15986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733936128 00000100:00100000:2.0:1789127496.382631:0:15986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 30 00000100:00100000:2.0:1789127496.382643:0:15986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df682e712c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:120b6615-98eb-47cd-be5f-d74b7a580836+15:14639:x1876035733936128:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:2.0:1789127496.382677:0:15986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127496.382704:0:15986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6000/0xeeacf7c0243019b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7fb8 expref: -99 pid: 15986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789127496.382891:0:15986:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1789127496.383106:0:15986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6000/0xeeacf7c0243019b9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7fb8 expref: 17 pid: 15986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127496.383124:0:15986:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df782a68300) 00010000:00010000:2.0:1789127496.383128:0:15986:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789127496.383134:0:15986:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6000/0xeeacf7c0243019b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7fb8 expref: 17 pid: 15986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127496.383152:0:15986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7aeab6000, rc 0) 00000100:00100000:2.0:1789127496.383287:0:15986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df682e712c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:120b6615-98eb-47cd-be5f-d74b7a580836+16:14639:x1876035733936128:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 646us (910us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1789127496.383294:0:15986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 30 00000100:00100000:0.0:1789127496.390009:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127496.390082:0:14773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733936384 00000100:00100000:2.0:1789127496.390094:0:14773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733936384 00000100:00100000:2.0:1789127496.390169:0:14773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 6 00000100:00100000:2.0:1789127496.390187:0:14773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae040780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:120b6615-98eb-47cd-be5f-d74b7a580836+16:14639:x1876035733936384:12345-192.168.206.40@tcp:35:lfs.0 00000100:00100000:2.0:1789127496.390688:0:14773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae040780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:120b6615-98eb-47cd-be5f-d74b7a580836+17:14639:x1876035733936384:12345-192.168.206.40@tcp:35:lfs.0 Request processed in 503us (690us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1789127496.390715:0:14773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 6 00010000:00010000:3.0:1789127496.435941:0:16036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127496.437514:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127496.440287:0:14771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733936640 00000100:00100000:3.0:1789127496.440305:0:14771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733936640 00000100:00100000:3.0:1789127496.440415:0:14771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 31 00000100:00100000:3.0:1789127496.440424:0:14771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df682e72d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:120b6615-98eb-47cd-be5f-d74b7a580836+17:14642:x1876035733936640:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:3.0:1789127496.440455:0:14771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127496.440482:0:14771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96c00/0xeeacf7c0243019c7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7fbf expref: -99 pid: 14771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127496.440603:0:14771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96e00/0xeeacf7c0243019ce lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127496.440620:0:14771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96e00/0xeeacf7c0243019ce lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127496.440632:0:14771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96e00/0xeeacf7c0243019ce lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789127496.440645:0:14771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789127496.440818:0:14771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96c00/0xeeacf7c0243019c7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7fbf expref: 20 pid: 14771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127496.440843:0:14771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96e00/0xeeacf7c0243019ce lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7fbf expref: 19 pid: 14771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127496.440851:0:14771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8df79f06c900) 00010000:00010000:3.0:1789127496.440961:0:14771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789127496.440967:0:14771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7bbd96e00, rc 0) 00000100:00100000:3.0:1789127496.442493:0:14771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df682e72d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:120b6615-98eb-47cd-be5f-d74b7a580836+19:14642:x1876035733936640:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 2058us (4981us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1789127496.442508:0:14771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 31 00000100:00100000:1.0:1789127496.446459:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127496.446546:0:14770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733936768 00000100:00100000:3.0:1789127496.446577:0:14770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733936768 00000100:00100000:3.0:1789127496.446658:0:14770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 32 00000100:00100000:3.0:1789127496.446670:0:14770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6826a6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:120b6615-98eb-47cd-be5f-d74b7a580836+19:14642:x1876035733936768:12345-192.168.206.40@tcp:54:lfs.0 00010000:00010000:3.0:1789127496.446758:0:14770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97400/0xeeacf7c0243019dc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127496.446780:0:14770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97400/0xeeacf7c0243019dc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127496.446849:0:14770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97400/0xeeacf7c0243019dc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127496.446882:0:14770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97400/0xeeacf7c0243019dc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127496.446890:0:14770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97400/0xeeacf7c0243019dc lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127496.446898:0:14770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97400/0xeeacf7c0243019dc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127496.446905:0:14770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd97400 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:3.0:1789127496.446910:0:14770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97400/0xeeacf7c0243019dc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127496.446918:0:14770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97400/0xeeacf7c0243019dc lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127496.446932:0:14770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8df79f06c900) 00010000:00010000:3.0:1789127496.446936:0:14770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789127496.446941:0:14770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97400/0xeeacf7c0243019dc lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127496.446967:0:14770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97400/0xeeacf7c0243019dc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127496.447086:0:14770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6826a6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:120b6615-98eb-47cd-be5f-d74b7a580836+19:14642:x1876035733936768:12345-192.168.206.40@tcp:54:lfs.0 Request processed in 414us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127496.447095:0:14770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 32 00000100:00100000:0.0:1789127496.448610:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127496.448727:0:14756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733936896 00000100:00100000:1.0:1789127496.448736:0:14756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733936896 00000100:00100000:1.0:1789127496.448836:0:14756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 0 00000100:00100000:1.0:1789127496.448848:0:14756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae040000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:120b6615-98eb-47cd-be5f-d74b7a580836+19:2346:x1876035733936896:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789127496.448864:0:14756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789127496.448892:0:14756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96e00/0xeeacf7c0243019ce lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7fbf expref: 19 pid: 14771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127496.448912:0:14756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8df79f06c900) 00010000:00010000:1.0:1789127496.448918:0:14756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789127496.449329:0:14756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae040000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:120b6615-98eb-47cd-be5f-d74b7a580836+18:2346:x1876035733936896:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 481us (729us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127496.449338:0:14756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 0 00000100:00100000:1.0:1789127496.451053:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127496.451128:0:14772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733937152 00000100:00100000:3.0:1789127496.451138:0:14772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733937152 00000100:00100000:3.0:1789127496.451196:0:14772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 7 00000100:00100000:3.0:1789127496.451207:0:14772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6826a4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:120b6615-98eb-47cd-be5f-d74b7a580836+18:14642:x1876035733937152:12345-192.168.206.40@tcp:35:lfs.0 00000100:00100000:3.0:1789127496.451633:0:14772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6826a4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:120b6615-98eb-47cd-be5f-d74b7a580836+19:14642:x1876035733937152:12345-192.168.206.40@tcp:35:lfs.0 Request processed in 426us (597us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1789127496.451642:0:14772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 7 00000100:00100000:0.0:1789127496.664202:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127496.672172:0:14769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733937408 00000100:00100000:2.0:1789127496.672195:0:14769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733937408 00000100:00100000:2.0:1789127496.672372:0:14769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 33 00000100:00100000:2.0:1789127496.672387:0:14769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae042940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:120b6615-98eb-47cd-be5f-d74b7a580836+19:14673:x1876035733937408:12345-192.168.206.40@tcp:101:cat.0 00010000:00010000:2.0:1789127496.672426:0:14769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127496.672457:0:14769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6000/0xeeacf7c0243019e3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7fc6 expref: -99 pid: 14769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127496.672607:0:14769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7200/0xeeacf7c0243019ea lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127496.672625:0:14769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7200/0xeeacf7c0243019ea lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127496.672638:0:14769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7200/0xeeacf7c0243019ea lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789127496.672652:0:14769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789127496.672891:0:14769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6000/0xeeacf7c0243019e3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7fc6 expref: 22 pid: 14769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127496.672916:0:14769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7200/0xeeacf7c0243019ea lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7fc6 expref: 21 pid: 14769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127496.672926:0:14769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8df79f06c900) 00010000:00010000:2.0:1789127496.672929:0:14769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789127496.672933:0:14769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7aeab7200, rc 0) 00000100:00100000:2.0:1789127496.673058:0:14769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae042940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:120b6615-98eb-47cd-be5f-d74b7a580836+21:14673:x1876035733937408:12345-192.168.206.40@tcp:101:cat.0 Request processed in 674us (8871us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1789127496.673068:0:14769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 33 00000100:00100000:0.0:1789127496.684510:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127496.684678:0:14773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733937664 00000100:00100000:2.0:1789127496.684690:0:14773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733937664 00000100:00100000:2.0:1789127496.684908:0:14773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 8 00000100:00100000:2.0:1789127496.684921:0:14773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae97a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:120b6615-98eb-47cd-be5f-d74b7a580836+21:14673:x1876035733937664:12345-192.168.206.40@tcp:35:cat.0 00000100:00100000:2.0:1789127496.687947:0:14773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae97a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:120b6615-98eb-47cd-be5f-d74b7a580836+22:14673:x1876035733937664:12345-192.168.206.40@tcp:35:cat.0 Request processed in 3013us (3439us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1789127496.687964:0:14773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 8 00000100:00100000:1.0:1789127496.694221:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127496.701240:0:14755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733937792 00000100:00100000:3.0:1789127496.701262:0:14755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733937792 00000100:00100000:3.0:1789127496.701379:0:14755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 1 00000100:00100000:3.0:1789127496.701391:0:14755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6820bc780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:120b6615-98eb-47cd-be5f-d74b7a580836+22:2348:x1876035733937792:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789127496.701411:0:14755:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127496.701453:0:14755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7200/0xeeacf7c0243019ea lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7fc6 expref: 22 pid: 14769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127496.701891:0:14755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8df79f06c900) 00010000:00010000:3.0:1789127496.701897:0:14755:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127496.701978:0:14755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6820bc780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:120b6615-98eb-47cd-be5f-d74b7a580836+21:2348:x1876035733937792:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 588us (7770us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127496.702089:0:14755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 1 00000100:00100000:0.0:1789127496.788219:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127496.788495:0:14770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733938048 00000100:00100000:3.0:1789127496.788509:0:14770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733938048 00000100:00100000:3.0:1789127496.788587:0:14770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 34 00000100:00100000:3.0:1789127496.788599:0:14770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae97a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:120b6615-98eb-47cd-be5f-d74b7a580836+21:14679:x1876035733938048:12345-192.168.206.40@tcp:101:dd.0 00010000:00010000:3.0:1789127496.788630:0:14770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127496.788655:0:14770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97400/0xeeacf7c0243019f8 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7fcd expref: -99 pid: 14770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127496.788823:0:14770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96c00/0xeeacf7c0243019ff lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127496.788840:0:14770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96c00/0xeeacf7c0243019ff lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127496.788855:0:14770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96c00/0xeeacf7c0243019ff lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789127496.788868:0:14770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789127496.789066:0:14770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97400/0xeeacf7c0243019f8 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7fcd expref: 24 pid: 14770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127496.789088:0:14770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96c00/0xeeacf7c0243019ff lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7fcd expref: 23 pid: 14770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127496.789098:0:14770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8df79f06c900) 00010000:00010000:3.0:1789127496.789101:0:14770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789127496.789106:0:14770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7bbd96c00, rc 0) 00000100:00100000:3.0:1789127496.789203:0:14770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae97a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:120b6615-98eb-47cd-be5f-d74b7a580836+23:14679:x1876035733938048:12345-192.168.206.40@tcp:101:dd.0 Request processed in 606us (1011us total) trans 8589934608 rc 0/0 00000100:00100000:3.0:1789127496.789213:0:14770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 34 00000100:00100000:0.0:1789127496.792274:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127496.793276:0:14771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733938304 00000100:00100000:3.0:1789127496.793296:0:14771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733938304 00000100:00100000:3.0:1789127496.793381:0:14771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 35 00000100:00100000:3.0:1789127496.793393:0:14771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae978b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:120b6615-98eb-47cd-be5f-d74b7a580836+23:14679:x1876035733938304:12345-192.168.206.40@tcp:36:dd.0 00010000:00010000:3.0:1789127496.793486:0:14771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789127496.793521:0:14771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96c00/0xeeacf7c0243019ff lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7fcd expref: 23 pid: 14770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127496.793546:0:14771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6400/0xeeacf7c0243019b2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7fb1 expref: 22 pid: 14769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127496.793559:0:14771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8df79f06c900) 00010000:00010000:3.0:1789127496.793564:0:14771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789127496.793863:0:14771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024301a0d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127496.793880:0:14771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024301a0d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127496.793892:0:14771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024301a0d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789127496.793955:0:14771:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:3.0:1789127496.793987:0:14771:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000068eff626 reply state 000000007cb7aa03 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024301a0d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127496.794020:0:14771:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789127496.794148:0:14771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae978b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:120b6615-98eb-47cd-be5f-d74b7a580836+24:14679:x1876035733938304:12345-192.168.206.40@tcp:36:dd.0 Request processed in 755us (1887us total) trans 8589934610 rc 0/0 00000100:00100000:3.0:1789127496.794156:0:14771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 35 00000020:00080000:3.0:1789127496.794161:0:14771:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789127496.797576:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024301a0d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127496.797599:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024301a0d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127496.797607:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024301a0d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127496.797614:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd96000 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:2.0:1789127496.797620:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024301a0d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127496.797627:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024301a0d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127496.797647:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8df79f06c900) 00010000:00010000:2.0:1789127496.797651:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789127496.797657:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024301a0d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127496.797689:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024301a0d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789127496.883587:0:14801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789127496.926299:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127496.927212:0:14772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733938560 00000100:00100000:3.0:1789127496.927226:0:14772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733938560 00000100:00100000:3.0:1789127496.927312:0:14772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 9 00000100:00100000:3.0:1789127496.927325:0:14772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae97bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:120b6615-98eb-47cd-be5f-d74b7a580836+23:14679:x1876035733938560:12345-192.168.206.40@tcp:35:dd.0 00000100:00100000:3.0:1789127496.927929:0:14772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae97bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:120b6615-98eb-47cd-be5f-d74b7a580836+24:14679:x1876035733938560:12345-192.168.206.40@tcp:35:dd.0 Request processed in 601us (1640us total) trans 8589934611 rc 0/0 00000100:00100000:3.0:1789127496.927939:0:14772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 9 00000100:00100000:1.0:1789127497.169548:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127497.169653:0:14770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733938688 00000100:00100000:3.0:1789127497.169661:0:14770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733938688 00000100:00100000:3.0:1789127497.169739:0:14770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 36 00000100:00100000:3.0:1789127497.169757:0:14770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6820bed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:120b6615-98eb-47cd-be5f-d74b7a580836+24:14693:x1876035733938688:12345-192.168.206.40@tcp:101:stat.0 00010000:00010000:3.0:1789127497.169779:0:14770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127497.169840:0:14770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96c00/0xeeacf7c024301a14 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7fd4 expref: -99 pid: 14770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.169921:0:14770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97400/0xeeacf7c024301a1b lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.169935:0:14770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97400/0xeeacf7c024301a1b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.169947:0:14770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97400/0xeeacf7c024301a1b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.169970:0:14770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024301a22 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.169978:0:14770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024301a22 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.169985:0:14770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024301a22 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.170220:0:14770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024301a29 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.170230:0:14770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024301a29 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.170238:0:14770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024301a29 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789127497.170272:0:14770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1789127497.170277:0:14770:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789127497.170311:0:14770:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024301a29 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.170323:0:14770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024301a29 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.170331:0:14770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97400/0xeeacf7c024301a1b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.170337:0:14770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97400/0xeeacf7c024301a1b lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.170355:0:14770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97400/0xeeacf7c024301a1b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.170361:0:14770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd97400 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:3.0:1789127497.170365:0:14770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97400/0xeeacf7c024301a1b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.170372:0:14770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97400/0xeeacf7c024301a1b lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.170384:0:14770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8df7906f6d00) 00010000:00010000:3.0:1789127497.170388:0:14770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127497.170392:0:14770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97400/0xeeacf7c024301a1b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.170399:0:14770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97400/0xeeacf7c024301a1b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.170412:0:14770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024301a22 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.170418:0:14770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024301a22 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.170423:0:14770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024301a22 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.170427:0:14770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd96a00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:3.0:1789127497.170430:0:14770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024301a22 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.170445:0:14770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024301a22 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.170452:0:14770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8df79f06c000) 00010000:00010000:3.0:1789127497.170455:0:14770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127497.170458:0:14770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024301a22 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.170464:0:14770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024301a22 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.170493:0:14770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96c00/0xeeacf7c024301a14 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7fd4 expref: 26 pid: 14770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.170507:0:14770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024301a29 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7fd4 expref: 25 pid: 14770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.170514:0:14770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8df79f06c900) 00010000:00010000:3.0:1789127497.170516:0:14770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789127497.170518:0:14770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7bbd96000, rc 0) 00000100:00100000:3.0:1789127497.170585:0:14770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6820bed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:120b6615-98eb-47cd-be5f-d74b7a580836+25:14693:x1876035733938688:12345-192.168.206.40@tcp:101:stat.0 Request processed in 831us (1044us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127497.170593:0:14770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 36 00000100:00080000:0.0:1789127497.170998:0:14765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789127497.234478:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127497.236296:0:14771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733938944 00000100:00100000:3.0:1789127497.236313:0:14771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733938944 00000100:00100000:3.0:1789127497.236413:0:14771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 37 00000100:00100000:3.0:1789127497.236424:0:14771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae979e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:120b6615-98eb-47cd-be5f-d74b7a580836+25:14699:x1876035733938944:12345-192.168.206.40@tcp:36:truncate.0 00010000:00010000:3.0:1789127497.236512:0:14771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127497.236546:0:14771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024301a29 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7fd4 expref: 25 pid: 14770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.236569:0:14771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8df79f06c900) 00010000:00010000:3.0:1789127497.236573:0:14771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789127497.237308:0:14771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96c00/0xeeacf7c024301a30 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.237328:0:14771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96c00/0xeeacf7c024301a30 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.237340:0:14771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96c00/0xeeacf7c024301a30 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789127497.237399:0:14771:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934612 00000004:00010000:3.0:1789127497.237429:0:14771:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000005b5f5188 reply state 00000000842e1c0f transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96c00/0xeeacf7c024301a30 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127497.237440:0:14771:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789127497.237585:0:14771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae979e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:120b6615-98eb-47cd-be5f-d74b7a580836+27:14699:x1876035733938944:12345-192.168.206.40@tcp:36:truncate.0 Request processed in 1160us (3119us total) trans 8589934613 rc 0/0 00000100:00100000:3.0:1789127497.237593:0:14771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 37 00000020:00080000:3.0:1789127497.237598:0:14771:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789127497.240465:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96c00/0xeeacf7c024301a30 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.240486:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96c00/0xeeacf7c024301a30 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.240494:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96c00/0xeeacf7c024301a30 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.240518:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd96c00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:3.0:1789127497.240524:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96c00/0xeeacf7c024301a30 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.240533:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96c00/0xeeacf7c024301a30 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.240552:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8df79f06c900) 00010000:00010000:3.0:1789127497.240556:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127497.240561:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96c00/0xeeacf7c024301a30 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.240567:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96c00/0xeeacf7c024301a30 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127497.409021:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127497.409161:0:14770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733939072 00000100:00100000:3.0:1789127497.409175:0:14770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733939072 00000100:00100000:3.0:1789127497.409256:0:14770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 38 00000100:00100000:3.0:1789127497.409268:0:14770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae979a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:120b6615-98eb-47cd-be5f-d74b7a580836+26:14713:x1876035733939072:12345-192.168.206.40@tcp:101:stat.0 00010000:00010000:3.0:1789127497.409303:0:14770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127497.409328:0:14770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96c00/0xeeacf7c024301a37 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7fdb expref: -99 pid: 14770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.409543:0:14770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024301a3e lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.409563:0:14770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024301a3e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.409576:0:14770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024301a3e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.409612:0:14770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024301a45 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.409621:0:14770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024301a45 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.409629:0:14770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024301a45 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.409763:0:14770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97400/0xeeacf7c024301a4c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.409773:0:14770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97400/0xeeacf7c024301a4c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.409781:0:14770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97400/0xeeacf7c024301a4c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789127497.409859:0:14770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:3.0:1789127497.409864:0:14770:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789127497.409886:0:14770:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97400/0xeeacf7c024301a4c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.409900:0:14770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97400/0xeeacf7c024301a4c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.409908:0:14770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024301a3e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.409916:0:14770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024301a3e lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.409933:0:14770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024301a3e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.409939:0:14770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd96000 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:3.0:1789127497.409944:0:14770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024301a3e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.409953:0:14770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024301a3e lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.409966:0:14770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8df7906f6d00) 00010000:00010000:3.0:1789127497.409982:0:14770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127497.409988:0:14770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024301a3e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.410515:0:14770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024301a3e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.410538:0:14770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024301a45 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.410546:0:14770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024301a45 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.410552:0:14770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024301a45 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.410557:0:14770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd96a00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:3.0:1789127497.410560:0:14770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024301a45 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.410578:0:14770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024301a45 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.410587:0:14770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8df79f06c000) 00010000:00010000:3.0:1789127497.410590:0:14770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127497.410593:0:14770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024301a45 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.410599:0:14770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024301a45 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.410642:0:14770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96c00/0xeeacf7c024301a37 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7fdb expref: 28 pid: 14770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.410657:0:14770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97400/0xeeacf7c024301a4c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7fdb expref: 27 pid: 14770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.410665:0:14770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8df79f06c900) 00010000:00010000:3.0:1789127497.410668:0:14770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789127497.410671:0:14770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7bbd97400, rc 0) 00000100:00100000:3.0:1789127497.411326:0:14770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae979a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:120b6615-98eb-47cd-be5f-d74b7a580836+27:14713:x1876035733939072:12345-192.168.206.40@tcp:101:stat.0 Request processed in 2056us (2316us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127497.411336:0:14770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 38 00010000:00010000:3.0:1789127497.459244:0:14758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127497.518462:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127497.521886:0:14769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733939328 00000100:00100000:2.0:1789127497.521906:0:14769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733939328 00000100:00100000:2.0:1789127497.522009:0:14769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 39 00000100:00100000:2.0:1789127497.522022:0:14769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae2f9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:120b6615-98eb-47cd-be5f-d74b7a580836+27:14723:x1876035733939328:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:2.0:1789127497.522061:0:14769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127497.522089:0:14769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7c00/0xeeacf7c024301a53 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7fe2 expref: -99 pid: 14769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789127497.522250:0:14769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1789127497.524428:0:14769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7c00/0xeeacf7c024301a53 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7fe2 expref: 29 pid: 14769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127497.524453:0:14769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df782a68300) 00010000:00010000:2.0:1789127497.524456:0:14769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789127497.524463:0:14769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7c00/0xeeacf7c024301a53 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7fe2 expref: 29 pid: 14769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127497.524481:0:14769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7aeab7c00, rc 0) 00000100:00100000:2.0:1789127497.524583:0:14769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae2f9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:120b6615-98eb-47cd-be5f-d74b7a580836+28:14723:x1876035733939328:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 2563us (6134us total) trans 8589934614 rc 301/301 00000100:00100000:2.0:1789127497.524594:0:14769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 39 00000100:00100000:2.0:1789127497.530216:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127497.530316:0:14773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733939584 00000100:00100000:3.0:1789127497.530329:0:14773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733939584 00000100:00100000:3.0:1789127497.530406:0:14773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 10 00000100:00100000:3.0:1789127497.530419:0:14773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aea72c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:120b6615-98eb-47cd-be5f-d74b7a580836+28:14723:x1876035733939584:12345-192.168.206.40@tcp:35:lfs.0 00000100:00100000:3.0:1789127497.530854:0:14773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aea72c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:120b6615-98eb-47cd-be5f-d74b7a580836+29:14723:x1876035733939584:12345-192.168.206.40@tcp:35:lfs.0 Request processed in 435us (651us total) trans 8589934615 rc 0/0 00000100:00100000:3.0:1789127497.530865:0:14773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 10 00000100:00100000:0.0:1789127497.587085:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127497.587345:0:15986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733939840 00000100:00100000:2.0:1789127497.587368:0:15986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733939840 00000100:00100000:2.0:1789127497.587538:0:15986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 40 00000100:00100000:2.0:1789127497.587549:0:15986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae97b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:120b6615-98eb-47cd-be5f-d74b7a580836+29:14729:x1876035733939840:12345-192.168.206.40@tcp:101:bash.0 00010000:00010000:2.0:1789127497.587583:0:15986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127497.587604:0:15986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7c00/0xeeacf7c024301a61 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7fe9 expref: -99 pid: 15986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127497.587698:0:15986:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6e00/0xeeacf7c024301a68 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127497.587711:0:15986:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97000/0xeeacf7c02430199d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7faa expref: 30 pid: 14770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127497.587721:0:15986:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97400/0xeeacf7c024301a4c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7fdb expref: 30 pid: 14770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127497.587727:0:15986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6e00/0xeeacf7c024301a68 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127497.591168:0:15986:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97400/0xeeacf7c024301a4c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7fdb expref: 30 pid: 14770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127497.591189:0:15986:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97400/0xeeacf7c024301a4c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7fdb expref: 30 pid: 14770 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127497.591206:0:15986:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df787b8de00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15986:1876035752801280:192.168.206.40@tcp:104: 00010000:00010000:2.0:1789127497.591315:0:15986:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97000/0xeeacf7c02430199d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7faa expref: 30 pid: 14770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127497.591341:0:15986:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97000/0xeeacf7c02430199d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7faa expref: 30 pid: 14770 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127497.591351:0:15986:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df787b8f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15986:1876035752801408:192.168.206.40@tcp:104: 00000100:00100000:2.0:1789127497.591376:0:15986:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7aea319c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789127497.595177:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127497.595232:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127497.595304:0:14754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733940096 00000100:00100000:3.0:1789127497.595312:0:14754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733940096 00010000:00010000:3.0:1789127497.595346:0:14754:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97000/0xeeacf7c02430199d lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7faa expref: 31 pid: 14770 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127497.595377:0:14754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733939968 00000100:00100000:3.0:1789127497.595379:0:14754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733939968 00010000:00010000:3.0:1789127497.595390:0:14754:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97400/0xeeacf7c024301a4c lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7fdb expref: 32 pid: 14770 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127497.595403:0:14754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 11 00000100:00100000:3.0:1789127497.595410:0:14754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7b4010450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:120b6615-98eb-47cd-be5f-d74b7a580836+32:2347:x1876035733940096:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789127497.595424:0:14754:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127497.595429:0:14754:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97000/0xeeacf7c02430199d lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7faa expref: 32 pid: 14770 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.595456:0:14754:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97000/0xeeacf7c02430199d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7faa expref: 32 pid: 14770 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.595475:0:14754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8df79f06c900) 00010000:00010000:3.0:1789127497.595480:0:14754:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6e00/0xeeacf7c024301a68 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.595489:0:14754:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6e00/0xeeacf7c024301a68 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.595501:0:14754:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127497.595541:0:14754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7b4010450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:120b6615-98eb-47cd-be5f-d74b7a580836+32:2347:x1876035733940096:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 131us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127497.595549:0:14754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 11 00000100:00100000:3.0:1789127497.595588:0:14754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 12 00000100:00100000:3.0:1789127497.595594:0:14754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeab8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:120b6615-98eb-47cd-be5f-d74b7a580836+31:2347:x1876035733939968:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789127497.595601:0:14754:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127497.595605:0:14754:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97400/0xeeacf7c024301a4c lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7fdb expref: 31 pid: 14770 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.595615:0:14754:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97400/0xeeacf7c024301a4c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7fdb expref: 31 pid: 14770 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.595625:0:14754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8df79f06c900) 00010000:00010000:3.0:1789127497.595628:0:14754:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6e00/0xeeacf7c024301a68 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.595636:0:14754:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6e00/0xeeacf7c024301a68 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.595644:0:14754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6e00/0xeeacf7c024301a68 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.595658:0:14754:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127497.595673:0:14754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeab8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:120b6615-98eb-47cd-be5f-d74b7a580836+31:2347:x1876035733939968:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 79us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127497.595679:0:14754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 12 00010000:00010000:2.0:1789127497.596955:0:15986:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97400/0xeeacf7c024301a4c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7fdb expref: 30 pid: 14770 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127497.597084:0:15986:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df787b8de00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15986:1876035752801280:192.168.206.40@tcp:104: 00010000:00010000:2.0:1789127497.597103:0:15986:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97000/0xeeacf7c02430199d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7faa expref: 29 pid: 14770 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127497.597113:0:15986:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df787b8f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15986:1876035752801408:192.168.206.40@tcp:104: 00010000:00010000:2.0:1789127497.597134:0:15986:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6e00/0xeeacf7c024301a68 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127497.597143:0:15986:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6e00/0xeeacf7c024301a68 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127497.597149:0:15986:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6e00/0xeeacf7c024301a68 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789127497.597166:0:15986:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:2.0:1789127497.597303:0:15986:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7c00/0xeeacf7c024301a61 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7fe9 expref: 30 pid: 15986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127497.597335:0:15986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6e00/0xeeacf7c024301a68 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7fe9 expref: 29 pid: 15986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127497.597343:0:15986:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8df79f06c900) 00010000:00010000:2.0:1789127497.597346:0:15986:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789127497.597349:0:15986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7aeab6e00, rc 0) 00000100:00100000:2.0:1789127497.597499:0:15986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae97b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:120b6615-98eb-47cd-be5f-d74b7a580836+29:14729:x1876035733939840:12345-192.168.206.40@tcp:101:bash.0 Request processed in 9951us (10532us total) trans 8589934616 rc 0/0 00000100:00100000:2.0:1789127497.597508:0:15986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 40 00000100:00100000:1.0:1789127497.599885:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127497.600075:0:14771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733940352 00000100:00100000:3.0:1789127497.600085:0:14771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733940352 00000100:00100000:3.0:1789127497.600159:0:14771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 41 00000100:00100000:3.0:1789127497.600169:0:14771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeabad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:120b6615-98eb-47cd-be5f-d74b7a580836+29:14729:x1876035733940352:12345-192.168.206.40@tcp:36:bash.0 00010000:00010000:3.0:1789127497.600398:0:14771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96c00/0xeeacf7c024301a76 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.600413:0:14771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96c00/0xeeacf7c024301a76 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.600424:0:14771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96c00/0xeeacf7c024301a76 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789127497.600482:0:14771:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000004:00010000:3.0:1789127497.600503:0:14771:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000055bfdfad reply state 00000000e481cc46 transno 8589934618 ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96c00/0xeeacf7c024301a76 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127497.600511:0:14771:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789127497.600587:0:14771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeabad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:120b6615-98eb-47cd-be5f-d74b7a580836+32:14729:x1876035733940352:12345-192.168.206.40@tcp:36:bash.0 Request processed in 420us (709us total) trans 8589934618 rc 0/0 00000100:00100000:3.0:1789127497.600594:0:14771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 41 00000020:00080000:3.0:1789127497.600599:0:14771:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789127497.602631:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127497.603177:0:14770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733940480 00000100:00100000:3.0:1789127497.603185:0:14770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733940480 00000100:00100000:3.0:1789127497.603237:0:14770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 42 00000100:00100000:3.0:1789127497.603247:0:14770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeabb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:120b6615-98eb-47cd-be5f-d74b7a580836+32:14729:x1876035733940480:12345-192.168.206.40@tcp:101:bash.0 00010000:00010000:3.0:1789127497.603268:0:14770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127497.603284:0:14770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024301a7d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7ff0 expref: -99 pid: 14770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.603351:0:14770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024301a7d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7ff0 expref: 33 pid: 14770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.603364:0:14770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024301a7d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7ff0 expref: 33 pid: 14770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.603382:0:14770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8df79f06c900) 00010000:00010000:3.0:1789127497.603385:0:14770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789127497.603389:0:14770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7bbd96a00, rc 0) 00000100:00100000:3.0:1789127497.603440:0:14770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeabb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:120b6615-98eb-47cd-be5f-d74b7a580836+33:14729:x1876035733940480:12345-192.168.206.40@tcp:101:bash.0 Request processed in 195us (817us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127497.603447:0:14770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 42 00010000:00010000:2.0:1789127497.607878:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96c00/0xeeacf7c024301a76 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127497.607895:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96c00/0xeeacf7c024301a76 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127497.607903:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96c00/0xeeacf7c024301a76 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127497.607909:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd96c00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:2.0:1789127497.607914:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96c00/0xeeacf7c024301a76 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127497.607923:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96c00/0xeeacf7c024301a76 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127497.607939:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8df79f06c900) 00010000:00010000:2.0:1789127497.607942:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789127497.607947:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96c00/0xeeacf7c024301a76 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127497.607983:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96c00/0xeeacf7c024301a76 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127497.608587:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127497.608674:0:14769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733940608 00000100:00100000:2.0:1789127497.608681:0:14769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733940608 00000100:00100000:2.0:1789127497.608764:0:14769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 43 00000100:00100000:2.0:1789127497.608773:0:14769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae97a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:120b6615-98eb-47cd-be5f-d74b7a580836+32:14729:x1876035733940608:12345-192.168.206.40@tcp:101:bash.0 00010000:00010000:2.0:1789127497.608826:0:14769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127497.608844:0:14769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7c00/0xeeacf7c024301a84 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7ff7 expref: -99 pid: 14769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127497.608928:0:14769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6000/0xeeacf7c024301a8b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127497.608941:0:14769:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6e00/0xeeacf7c024301a68 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7fe9 expref: 33 pid: 15986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127497.608949:0:14769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6000/0xeeacf7c024301a8b lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127497.608991:0:14769:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6e00/0xeeacf7c024301a68 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7fe9 expref: 33 pid: 15986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127497.609011:0:14769:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6e00/0xeeacf7c024301a68 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7fe9 expref: 33 pid: 15986 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127497.609036:0:14769:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df787b8f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14769:1876035752801536:192.168.206.40@tcp:104: 00000100:00100000:2.0:1789127497.609113:0:14769:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7aea319c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789127497.612266:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127497.612643:0:14769:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df787b8f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14769:1876035752801536:192.168.206.40@tcp:104: 00010000:00010000:2.0:1789127497.612665:0:14769:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6000/0xeeacf7c024301a8b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127497.612778:0:14754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733940736 00000100:00100000:3.0:1789127497.612784:0:14754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733940736 00010000:00010000:3.0:1789127497.612873:0:14754:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6e00/0xeeacf7c024301a68 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7fe9 expref: 34 pid: 15986 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127497.612939:0:14754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 13 00000100:00100000:3.0:1789127497.612948:0:14754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeaba940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:120b6615-98eb-47cd-be5f-d74b7a580836+34:2348:x1876035733940736:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789127497.612962:0:14754:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127497.612968:0:14754:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6e00/0xeeacf7c024301a68 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7fe9 expref: 34 pid: 15986 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.612989:0:14754:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6e00/0xeeacf7c024301a68 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7fe9 expref: 34 pid: 15986 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.613044:0:14754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6e00/0xeeacf7c024301a68 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7fe9 expref: 34 pid: 15986 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.613058:0:14754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8df79f06c900) 00010000:00010000:3.0:1789127497.613063:0:14754:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6000/0xeeacf7c024301a8b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.613072:0:14754:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6000/0xeeacf7c024301a8b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.613079:0:14754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6000/0xeeacf7c024301a8b lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.613149:0:14754:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127497.613200:0:14754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeaba940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:120b6615-98eb-47cd-be5f-d74b7a580836+33:2348:x1876035733940736:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 253us (944us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127497.613207:0:14754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 13 00010000:00010000:0.0:1789127497.615557:0:14769:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6000/0xeeacf7c024301a8b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127497.615571:0:14769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6000/0xeeacf7c024301a8b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789127497.615614:0:14769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1789127497.615619:0:14769:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789127497.615642:0:14769:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6000/0xeeacf7c024301a8b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127497.615679:0:14769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7c00/0xeeacf7c024301a84 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7ff7 expref: 33 pid: 14769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127497.615698:0:14769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6000/0xeeacf7c024301a8b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7ff7 expref: 32 pid: 14769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127497.615706:0:14769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8df79f06c900) 00010000:00010000:0.0:1789127497.615708:0:14769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789127497.615712:0:14769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7aeab6000, rc 0) 00000100:00100000:0.0:1789127497.615837:0:14769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae97a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:120b6615-98eb-47cd-be5f-d74b7a580836+32:14729:x1876035733940608:12345-192.168.206.40@tcp:101:bash.0 Request processed in 7064us (7254us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127497.615857:0:14769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 43 00000100:00100000:1.0:1789127497.619560:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127497.619643:0:14755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733940992 00000100:00100000:0.0:1789127497.619652:0:14755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733940992 00000100:00100000:0.0:1789127497.619741:0:14755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 2 00000100:00100000:0.0:1789127497.619751:0:14755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeab8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:120b6615-98eb-47cd-be5f-d74b7a580836+32:14729:x1876035733940992:12345-192.168.206.40@tcp:103:bash.0 00010000:00010000:0.0:1789127497.619766:0:14755:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1789127497.619908:0:14755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6000/0xeeacf7c024301a8b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7ff7 expref: 32 pid: 14769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127497.619932:0:14755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024301a7d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7ff0 expref: 31 pid: 14770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127497.619942:0:14755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8df79f06c900) 00010000:00010000:0.0:1789127497.619952:0:14755:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789127497.622223:0:14755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeab8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:120b6615-98eb-47cd-be5f-d74b7a580836+30:14729:x1876035733940992:12345-192.168.206.40@tcp:103:bash.0 Request processed in 2466us (2663us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127497.622236:0:14755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 2 00000100:00100000:1.0:1789127497.624228:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127497.624311:0:14770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733941120 00000100:00100000:3.0:1789127497.624318:0:14770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733941120 00000100:00100000:3.0:1789127497.624394:0:14770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 44 00000100:00100000:3.0:1789127497.624403:0:14770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeabb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:120b6615-98eb-47cd-be5f-d74b7a580836+30:14729:x1876035733941120:12345-192.168.206.40@tcp:58:bash.0 00010000:00010000:3.0:1789127497.624518:0:14770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024301a92 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.624532:0:14770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024301a92 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.624543:0:14770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024301a92 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789127497.625274:0:14770:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789127497.625427:0:14770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:3.0:1789127497.625488:0:14770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:3.0:1789127497.625705:0:14770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeabb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:120b6615-98eb-47cd-be5f-d74b7a580836+30:14729:x1876035733941120:12345-192.168.206.40@tcp:58:bash.0 Request processed in 1300us (1480us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127497.625714:0:14770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 44 00000100:00100000:0.0:1789127497.628190:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127497.628270:0:14771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733941248 00000100:00100000:3.0:1789127497.628278:0:14771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733941248 00000100:00100000:3.0:1789127497.628345:0:14771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 45 00000100:00100000:3.0:1789127497.628354:0:14771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae978780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:120b6615-98eb-47cd-be5f-d74b7a580836+30:14729:x1876035733941248:12345-192.168.206.40@tcp:101:bash.0 00010000:00010000:3.0:1789127497.628371:0:14771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127497.628388:0:14771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96e00/0xeeacf7c024301a99 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b7ffe expref: -99 pid: 14771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.628443:0:14771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024301a92 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.628454:0:14771:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96e00/0xeeacf7c024301a99 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7ffe expref: 31 pid: 14771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.628470:0:14771:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024301a92 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.628483:0:14771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96e00/0xeeacf7c024301a99 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7ffe expref: 31 pid: 14771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.628495:0:14771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8df79f06c000) 00010000:00010000:3.0:1789127497.628508:0:14771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789127497.628512:0:14771:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96e00/0xeeacf7c024301a99 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7ffe expref: 31 pid: 14771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.628520:0:14771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7bbd96e00, rc 0) 00000100:00100000:3.0:1789127497.628568:0:14771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae978780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:120b6615-98eb-47cd-be5f-d74b7a580836+31:14729:x1876035733941248:12345-192.168.206.40@tcp:101:bash.0 Request processed in 214us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127497.628575:0:14771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 45 00000100:00100000:3.0:1789127497.715513:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7aeaba1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1876035752801664:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789127497.715578:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127497.716304:0:15459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752801664 00000100:00100000:1.0:1789127497.716312:0:15459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752801664 00000100:00100000:1.0:1789127497.716374:0:15459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789127497.716383:0:15459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df68265cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876035752801664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789127497.716414:0:15459:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789127497.716465:0:15459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df68265cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876035752801664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (886us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127497.716472:0:15459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789127497.716524:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7aeaba1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1876035752801664:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789127497.717111:0:14765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1789127497.907491:0:14801:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789127497.907501:0:14801:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789127497.907541:0:14801:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1789127497.907548:0:14801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1789127497.907682:0:14801:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df787b8f480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14801:1876035752801792:192.168.206.40@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789127497.907809:0:14801:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7aea31f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789127497.918004:0:14801:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df787b8f480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14801:1876035752801792:192.168.206.40@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789127497.932110:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127497.932477:0:14780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733941376 00000100:00100000:0.0:1789127497.932486:0:14780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733941376 00000100:00100000:0.0:1789127497.932538:0:14780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 0 00000100:00100000:0.0:1789127497.932548:0:14780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeaba1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:120b6615-98eb-47cd-be5f-d74b7a580836+31:14730:x1876035733941376:12345-192.168.206.40@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1789127497.932626:0:14780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeaba1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:120b6615-98eb-47cd-be5f-d74b7a580836+31:14730:x1876035733941376:12345-192.168.206.40@tcp:900:lhsmtool_posix.0 Request processed in 78us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127497.932633:0:14780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 0 00000100:00100000:0.0:1789127497.938557:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127497.938671:0:15986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733941504 00000100:00100000:2.0:1789127497.938680:0:15986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733941504 00000100:00100000:2.0:1789127497.938754:0:15986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 46 00000100:00100000:2.0:1789127497.938765:0:15986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae979680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:120b6615-98eb-47cd-be5f-d74b7a580836+31:14730:x1876035733941504:12345-192.168.206.40@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789127497.938836:0:15986:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789127497.939176:0:15986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae979680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:120b6615-98eb-47cd-be5f-d74b7a580836+31:14730:x1876035733941504:12345-192.168.206.40@tcp:53:lhsmtool_posix.0 Request processed in 412us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127497.939184:0:15986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 46 00000100:00100000:2.0:1789127497.955070:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127497.958664:0:14769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733941632 00000100:00100000:0.0:1789127497.958678:0:14769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733941632 00000100:00100000:0.0:1789127497.959574:0:14769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 47 00000100:00100000:0.0:1789127497.959589:0:14769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df787b8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:120b6615-98eb-47cd-be5f-d74b7a580836+31:14730:x1876035733941632:12345-192.168.206.40@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789127497.959658:0:14769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c024301aa0 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127497.959673:0:14769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c024301aa0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127497.959687:0:14769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c024301aa0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127497.959761:0:14769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729800/0xeeacf7c024301aa7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127497.959770:0:14769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729800/0xeeacf7c024301aa7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127497.959804:0:14769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729800/0xeeacf7c024301aa7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127497.959827:0:14769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c024301aae lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127497.959837:0:14769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c024301aae lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127497.963433:0:14769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c024301aae lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789127497.963505:0:14769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1789127497.963510:0:14769:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789127497.963524:0:14769:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c024301aae lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127497.963537:0:14769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c024301aa0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127497.963543:0:14769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c024301aa0 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127497.963550:0:14769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c024301aa0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127497.963556:0:14769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7ae729c00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:0.0:1789127497.963560:0:14769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c024301aa0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127497.963568:0:14769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c024301aa0 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127497.963581:0:14769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8df798cd5100) 00010000:00010000:0.0:1789127497.963584:0:14769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127497.963588:0:14769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c024301aa0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127497.963593:0:14769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729c00/0xeeacf7c024301aa0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127497.963608:0:14769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729800/0xeeacf7c024301aa7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127497.963623:0:14769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729800/0xeeacf7c024301aa7 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127497.963629:0:14769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729800/0xeeacf7c024301aa7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127497.963633:0:14769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7ae729800 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:0.0:1789127497.963636:0:14769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729800/0xeeacf7c024301aa7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127497.963642:0:14769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729800/0xeeacf7c024301aa7 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127497.963651:0:14769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff8df782a68a00) 00010000:00010000:0.0:1789127497.963653:0:14769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127497.963656:0:14769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729800/0xeeacf7c024301aa7 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127497.963662:0:14769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729800/0xeeacf7c024301aa7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127497.963679:0:14769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c024301aae lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127497.963685:0:14769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c024301aae lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127497.963690:0:14769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c024301aae lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127497.963695:0:14769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7ae729e00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:0.0:1789127497.963718:0:14769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c024301aae lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127497.963725:0:14769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c024301aae lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127497.963733:0:14769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8df79f06c000) 00010000:00010000:0.0:1789127497.963735:0:14769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127497.963739:0:14769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c024301aae lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127497.963744:0:14769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7ae729e00/0xeeacf7c024301aae lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127497.964102:0:14769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df787b8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:120b6615-98eb-47cd-be5f-d74b7a580836+31:14730:x1876035733941632:12345-192.168.206.40@tcp:34:lhsmtool_posix.0 Request processed in 4512us (9034us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127497.964112:0:14769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 47 00000100:00100000:1.0:1789127497.972157:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127497.972229:0:14770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733941888 00000100:00100000:3.0:1789127497.972238:0:14770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733941888 00000100:00100000:3.0:1789127497.972288:0:14770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 48 00000100:00100000:3.0:1789127497.972296:0:14770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeab9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:120b6615-98eb-47cd-be5f-d74b7a580836+31:14730:x1876035733941888:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789127497.972314:0:14770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127497.972330:0:14770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024301ab5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b8005 expref: -99 pid: 14770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.972522:0:14770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c024301abc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.972535:0:14770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c024301abc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.972546:0:14770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c024301abc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789127497.972556:0:14770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789127497.972658:0:14770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c024301abc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.972666:0:14770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c024301abc lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.972673:0:14770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c024301abc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.972679:0:14770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd97800 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:3.0:1789127497.972683:0:14770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c024301abc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.972691:0:14770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c024301abc lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.973495:0:14770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8df79f06c000) 00010000:00010000:3.0:1789127497.973500:0:14770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789127497.973506:0:14770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c024301abc lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.973513:0:14770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c024301abc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.973565:0:14770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024301ab5 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b8005 expref: 33 pid: 14770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.973576:0:14770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8df798cd5100) 00010000:00010000:3.0:1789127497.973578:0:14770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789127497.973582:0:14770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024301ab5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b8005 expref: 33 pid: 14770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127497.973605:0:14770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7bbd97e00, rc 0) 00000100:00100000:3.0:1789127497.973934:0:14770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeab9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:120b6615-98eb-47cd-be5f-d74b7a580836+32:14730:x1876035733941888:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 Request processed in 1637us (1783us total) trans 8589934619 rc 301/301 00000100:00100000:3.0:1789127497.973942:0:14770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 48 00000100:00100000:1.0:1789127497.996100:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127497.996197:0:14771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733942016 00000100:00100000:3.0:1789127497.996206:0:14771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733942016 00000100:00100000:3.0:1789127497.996265:0:14771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 49 00000100:00100000:3.0:1789127497.996274:0:14771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeab92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:120b6615-98eb-47cd-be5f-d74b7a580836+32:14730:x1876035733942016:12345-192.168.206.40@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789127497.996312:0:14771:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789127497.996410:0:14771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeab92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:120b6615-98eb-47cd-be5f-d74b7a580836+32:14730:x1876035733942016:12345-192.168.206.40@tcp:53:lhsmtool_posix.0 Request processed in 137us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127497.996417:0:14771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 49 00000100:00100000:1.0:1789127498.003489:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127498.003673:0:15986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733942272 00000100:00100000:2.0:1789127498.003682:0:15986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733942272 00000100:00100000:2.0:1789127498.003757:0:15986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 50 00000100:00100000:2.0:1789127498.003766:0:15986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeab9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:120b6615-98eb-47cd-be5f-d74b7a580836+32:14730:x1876035733942272:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789127498.003785:0:15986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127498.003892:0:15986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6200/0xeeacf7c024301aca lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b800c expref: -99 pid: 15986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789127498.004530:0:15986:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x7:0x0], count =27 00000004:00080000:2.0:1789127498.004536:0:15986:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x7:0x0]+27 in llog 00000004:00080000:2.0:1789127498.004595:0:15986:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:2.0:1789127498.005198:0:15986:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7800/0xeeacf7c024301ad1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.005214:0:15986:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7800/0xeeacf7c024301ad1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.005225:0:15986:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7800/0xeeacf7c024301ad1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.005283:0:15986:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6200/0xeeacf7c024301aca lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b800c expref: 35 pid: 15986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.005300:0:15986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7800/0xeeacf7c024301ad1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b800c expref: 34 pid: 15986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.005309:0:15986:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8df7906f6700) 00010000:00010000:2.0:1789127498.005312:0:15986:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789127498.005315:0:15986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7aeab7800, rc 0) 00000100:00100000:2.0:1789127498.005416:0:15986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeab9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:120b6615-98eb-47cd-be5f-d74b7a580836+34:14730:x1876035733942272:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 Request processed in 1650us (1933us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1789127498.005425:0:15986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 50 00000100:00100000:2.0:1789127498.010556:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127498.010716:0:14771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733942528 00000100:00100000:3.0:1789127498.010724:0:14771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733942528 00000100:00100000:3.0:1789127498.010783:0:14771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 51 00000100:00100000:3.0:1789127498.010838:0:14771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df787b8de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:120b6615-98eb-47cd-be5f-d74b7a580836+34:14730:x1876035733942528:12345-192.168.206.40@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789127498.010889:0:14771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127498.010915:0:14771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7800/0xeeacf7c024301ad1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b800c expref: 34 pid: 15986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127498.010933:0:14771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8df7906f6700) 00010000:00010000:3.0:1789127498.010944:0:14771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789127498.010978:0:14771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024301adf lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127498.011243:0:14771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024301adf lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127498.011253:0:14771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024301adf lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.011332:0:14771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6200/0xeeacf7c024301ae6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xdece9038 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.011352:0:14771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6200/0xeeacf7c024301ae6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xdece9038 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.011361:0:14771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6200/0xeeacf7c024301ae6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xdece9038 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.011434:0:14771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024301adf lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.011442:0:14771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024301adf lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.011448:0:14771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024301adf lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.011454:0:14771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd97e00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:2.0:1789127498.011458:0:14771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024301adf lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.011465:0:14771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024301adf lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.011474:0:14771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8df7906f6d00) 00010000:00010000:2.0:1789127498.011477:0:14771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789127498.011481:0:14771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024301adf lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.011487:0:14771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024301adf lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.011497:0:14771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6200/0xeeacf7c024301ae6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xdece9038 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.011509:0:14771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6200/0xeeacf7c024301ae6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xdece9038 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.011515:0:14771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6200/0xeeacf7c024301ae6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xdece9038 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.011521:0:14771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7aeab6200 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:2.0:1789127498.011524:0:14771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6200/0xeeacf7c024301ae6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xdece9038 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.011530:0:14771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6200/0xeeacf7c024301ae6 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xdece9038 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.011539:0:14771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xdece9038 (ffff8df7906f6b00) 00010000:00010000:2.0:1789127498.011541:0:14771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789127498.011544:0:14771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6200/0xeeacf7c024301ae6 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xdece9038 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.011550:0:14771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6200/0xeeacf7c024301ae6 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xdece9038 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127498.011647:0:14771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df787b8de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:120b6615-98eb-47cd-be5f-d74b7a580836+33:14730:x1876035733942528:12345-192.168.206.40@tcp:36:lhsmtool_posix.0 Request processed in 812us (1099us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789127498.011656:0:14771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 51 00000100:00100000:1.0:1789127498.015609:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127498.015752:0:14770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733942656 00000100:00100000:3.0:1789127498.015760:0:14770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733942656 00000100:00100000:3.0:1789127498.015842:0:14770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 52 00000100:00100000:3.0:1789127498.015851:0:14770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeab8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:120b6615-98eb-47cd-be5f-d74b7a580836+33:14730:x1876035733942656:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789127498.015868:0:14770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127498.015887:0:14770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c024301aed lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b8013 expref: -99 pid: 14770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127498.015918:0:14770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96400/0xeeacf7c024301af4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127498.015931:0:14770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96400/0xeeacf7c024301af4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127498.015941:0:14770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96400/0xeeacf7c024301af4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127498.016056:0:14770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c024301aed lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b8013 expref: 35 pid: 14770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127498.016074:0:14770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96400/0xeeacf7c024301af4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b8013 expref: 34 pid: 14770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127498.016093:0:14770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8df79f06cc00) 00010000:00010000:3.0:1789127498.016096:0:14770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789127498.016100:0:14770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7bbd96400, rc 0) 00000100:00100000:3.0:1789127498.016155:0:14770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeab8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:120b6615-98eb-47cd-be5f-d74b7a580836+34:14730:x1876035733942656:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 Request processed in 306us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127498.016163:0:14770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 52 00000100:00100000:3.0:1789127498.024067:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127498.024719:0:14771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733942912 00000100:00100000:2.0:1789127498.024728:0:14771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733942912 00000100:00100000:2.0:1789127498.024782:0:14771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 53 00000100:00100000:2.0:1789127498.024890:0:14771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df68265fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:120b6615-98eb-47cd-be5f-d74b7a580836+34:14730:x1876035733942912:12345-192.168.206.40@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789127498.024960:0:14771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6200/0xeeacf7c024301afb lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.024984:0:14771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6200/0xeeacf7c024301afb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.024996:0:14771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6200/0xeeacf7c024301afb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789127498.025294:0:14771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:2.0:1789127498.025303:0:14771:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 444181513806ns, next at 445181512059ns, rc = 0 00000004:00010000:2.0:1789127498.025375:0:14771:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000001a5e7895 reply state 00000000126e42a5 transno 8589934621 ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6200/0xeeacf7c024301afb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127498.025384:0:14771:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789127498.025506:0:14771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df68265fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:120b6615-98eb-47cd-be5f-d74b7a580836+36:14730:x1876035733942912:12345-192.168.206.40@tcp:36:lhsmtool_posix.0 Request processed in 715us (1445us total) trans 8589934621 rc 0/0 00000100:00100000:2.0:1789127498.025514:0:14771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 53 00010000:00010000:3.0:1789127498.037016:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6200/0xeeacf7c024301afb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127498.037042:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6200/0xeeacf7c024301afb lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127498.037048:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6200/0xeeacf7c024301afb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127498.037054:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7aeab6200 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:3.0:1789127498.037058:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6200/0xeeacf7c024301afb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127498.037065:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6200/0xeeacf7c024301afb lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127498.037080:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8df79f06cc00) 00010000:00010000:3.0:1789127498.037084:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789127498.037088:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6200/0xeeacf7c024301afb lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127498.037094:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6200/0xeeacf7c024301afb lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127498.037272:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127498.037979:0:14770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733943040 00000100:00100000:3.0:1789127498.037989:0:14770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733943040 00000100:00100000:3.0:1789127498.038193:0:14770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 54 00000100:00100000:3.0:1789127498.038203:0:14770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeab8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:120b6615-98eb-47cd-be5f-d74b7a580836+35:14730:x1876035733943040:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789127498.038225:0:14770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127498.038242:0:14770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c024301b02 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b801a expref: -99 pid: 14770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127498.038298:0:14770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c024301b02 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b801a expref: 36 pid: 14770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127498.038310:0:14770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c024301b02 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b801a expref: 36 pid: 14770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127498.038328:0:14770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8df79f06cc00) 00010000:00010000:3.0:1789127498.038342:0:14770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789127498.038345:0:14770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7bbd97800, rc 0) 00000100:00100000:3.0:1789127498.039046:0:14770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeab8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:120b6615-98eb-47cd-be5f-d74b7a580836+36:14730:x1876035733943040:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 Request processed in 842us (1775us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127498.039055:0:14770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 54 00000100:00100000:1.0:1789127498.045122:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127498.045214:0:15455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733943168 00000100:00100000:0.0:1789127498.045223:0:15455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733943168 00000100:00100000:0.0:1789127498.045292:0:15455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 12 00000100:00100000:0.0:1789127498.045302:0:15455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeabb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:120b6615-98eb-47cd-be5f-d74b7a580836+5:2348:x1876035733943168:12345-192.168.206.40@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1789127498.046300:0:14765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789127498.046929:0:15455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeabb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:120b6615-98eb-47cd-be5f-d74b7a580836+6:2348:x1876035733943168:12345-192.168.206.40@tcp:2:lhsmtool_posix.0 Request processed in 1622us (1808us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1789127498.046947:0:15455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 12 00000100:00100000:1.0:1789127498.051316:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127498.052904:0:14773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733943424 00000100:00100000:3.0:1789127498.052917:0:14773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733943424 00000100:00100000:3.0:1789127498.053200:0:14773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 11 00000100:00100000:3.0:1789127498.053211:0:14773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeabbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:120b6615-98eb-47cd-be5f-d74b7a580836+36:14730:x1876035733943424:12345-192.168.206.40@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789127498.053466:0:14773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeabbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:120b6615-98eb-47cd-be5f-d74b7a580836+37:14730:x1876035733943424:12345-192.168.206.40@tcp:35:lhsmtool_posix.0 Request processed in 256us (2159us total) trans 8589934622 rc 0/0 00000100:00100000:3.0:1789127498.053481:0:14773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 11 00000100:00100000:1.0:1789127498.056561:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127498.056716:0:14769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733943680 00000100:00100000:0.0:1789127498.056724:0:14769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733943680 00000100:00100000:0.0:1789127498.056776:0:14769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 55 00000100:00100000:0.0:1789127498.056785:0:14769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeaba580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:120b6615-98eb-47cd-be5f-d74b7a580836+37:14730:x1876035733943680:12345-192.168.206.40@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789127498.056919:0:14769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeaba580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:120b6615-98eb-47cd-be5f-d74b7a580836+37:14730:x1876035733943680:12345-192.168.206.40@tcp:57:lhsmtool_posix.0 Request processed in 135us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127498.056937:0:14769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 55 00000100:00100000:1.0:1789127498.061956:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127498.062098:0:15986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733943808 00000100:00100000:2.0:1789127498.062106:0:15986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733943808 00000100:00100000:2.0:1789127498.062161:0:15986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 56 00000100:00100000:2.0:1789127498.062170:0:15986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeab9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:120b6615-98eb-47cd-be5f-d74b7a580836+37:14730:x1876035733943808:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789127498.062191:0:15986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127498.062211:0:15986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6200/0xeeacf7c024301b09 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b8021 expref: -99 pid: 15986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.062272:0:15986:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7800/0xeeacf7c024301b10 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.062287:0:15986:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7800/0xeeacf7c024301b10 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.062314:0:15986:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7800/0xeeacf7c024301b10 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789127498.062345:0:15986:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789127498.062359:0:15986:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7800/0xeeacf7c024301b10 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.062382:0:15986:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6200/0xeeacf7c024301b09 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b8021 expref: 39 pid: 15986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.062400:0:15986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7800/0xeeacf7c024301b10 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b8021 expref: 38 pid: 15986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.062409:0:15986:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8df79f06cc00) 00010000:00010000:2.0:1789127498.062412:0:15986:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789127498.062415:0:15986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7aeab7800, rc 0) 00000100:00100000:2.0:1789127498.062480:0:15986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeab9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:120b6615-98eb-47cd-be5f-d74b7a580836+38:14730:x1876035733943808:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 Request processed in 310us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127498.062487:0:15986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 56 00000100:00100000:1.0:1789127498.067410:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127498.067631:0:15456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733943936 00000100:00100000:2.0:1789127498.067639:0:15456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733943936 00000100:00100000:2.0:1789127498.067688:0:15456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 13 00000100:00100000:2.0:1789127498.067696:0:15456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7aeab83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:120b6615-98eb-47cd-be5f-d74b7a580836+6:2346:x1876035733943936:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789127498.067712:0:15456:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127498.067729:0:15456:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000067de6d11/0xeeacf7c024301b17 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b8028 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789127498.067768:0:15456:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa3eb49, blocks: 0x1 00010000:00010000:2.0:1789127498.067785:0:15456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=444s v=(0 0) 00010000:00010000:2.0:1789127498.067825:0:15456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127498.067834:0:15456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067de6d11/0xeeacf7c024301b17 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b8028 expref: 7 pid: 15456 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.067852:0:15456:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000067de6d11/0xeeacf7c024301b17 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b8028 expref: 7 pid: 15456 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.067864:0:15456:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7aeab7e00, rc 0) 00000100:00100000:2.0:1789127498.068234:0:15456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7aeab83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:120b6615-98eb-47cd-be5f-d74b7a580836+7:2346:x1876035733943936:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 Request processed in 537us (831us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127498.068243:0:15456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 13 00000100:00100000:1.0:1789127498.071384:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127498.072239:0:14769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733944192 00000100:00100000:0.0:1789127498.072250:0:14769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733944192 00000100:00100000:0.0:1789127498.072374:0:14769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 57 00000100:00100000:0.0:1789127498.072384:0:14769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df78efcfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:120b6615-98eb-47cd-be5f-d74b7a580836+38:14730:x1876035733944192:12345-192.168.206.40@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789127498.072508:0:14769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df78efcfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:120b6615-98eb-47cd-be5f-d74b7a580836+38:14730:x1876035733944192:12345-192.168.206.40@tcp:57:lhsmtool_posix.0 Request processed in 126us (1134us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127498.072516:0:14769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 57 00000100:00100000:1.0:1789127498.077884:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127498.077979:0:15986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733944320 00000100:00100000:2.0:1789127498.077988:0:15986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733944320 00000100:00100000:2.0:1789127498.078053:0:15986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 58 00000100:00100000:2.0:1789127498.078063:0:15986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df78efce580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:120b6615-98eb-47cd-be5f-d74b7a580836+38:14730:x1876035733944320:12345-192.168.206.40@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1789127498.137036:0:15986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df78efce580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:120b6615-98eb-47cd-be5f-d74b7a580836+38:14730:x1876035733944320:12345-192.168.206.40@tcp:44:lhsmtool_posix.0 Request processed in 58955us (59142us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127498.137050:0:15986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 58 00000001:00080000:3.0:1789127498.137539:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934595 is committed 00000001:00080000:3.0:1789127498.137549:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934594 is committed 00000001:00080000:3.0:1789127498.137556:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934597 is committed 00000001:00080000:3.0:1789127498.137563:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934621 is committed 00000004:00080000:3.0:1789127498.137581:0:5852:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:3.0:1789127498.137616:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000001:00080000:3.0:1789127498.137624:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000100:00100000:1.0:1789127498.137933:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789127498.137951:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df787b8c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1876035752801920:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789127498.138014:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127498.138222:0:15455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752801920 00000100:00100000:2.0:1789127498.138229:0:15455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752801920 00000100:00100000:2.0:1789127498.138284:0:15455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789127498.138293:0:15455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df78efccb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1876035752801920:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1789127498.138444:0:15455:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1789127498.138448:0:15455:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1789127498.138451:0:15455:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789127498.138453:0:15455:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1789127497 -> 1789127497 00002000:00010000:2.0:1789127498.138456:0:15455:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789127498.138493:0:15455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df78efccb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3300:x1876035752801920:12345-0@lo:2:osp-syn-1-0.0 Request processed in 201us (479us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1789127498.138500:0:15455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1789127498.138729:0:14765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1789127498.138761:0:3300:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8df787b8c780/2, rc 0, transno 8589934595 00000100:00100000:1.0:1789127498.138767:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df787b8c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1876035752801920:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789127498.142950:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127498.143184:0:15456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733944448 00000100:00100000:2.0:1789127498.143193:0:15456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733944448 00000100:00100000:2.0:1789127498.143290:0:15456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 15 00000100:00100000:2.0:1789127498.143300:0:15456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df78efcf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:120b6615-98eb-47cd-be5f-d74b7a580836+7:2348:x1876035733944448:12345-192.168.206.40@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1789127498.143409:0:15456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df78efcf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:120b6615-98eb-47cd-be5f-d74b7a580836+7:2348:x1876035733944448:12345-192.168.206.40@tcp:16:lhsmtool_posix.0 Request processed in 110us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127498.143417:0:15456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 15 00000100:00100000:1.0:1789127498.146667:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127498.146836:0:14771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733944704 00000100:00100000:2.0:1789127498.146846:0:14771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733944704 00000100:00100000:2.0:1789127498.146905:0:14771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 59 00000100:00100000:2.0:1789127498.146916:0:14771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df78efcc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:120b6615-98eb-47cd-be5f-d74b7a580836+13:14730:x1876035733944704:12345-192.168.206.40@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789127498.146965:0:14771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789127498.147012:0:14771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7800/0xeeacf7c024301b10 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b8021 expref: 13 pid: 15986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.147040:0:14771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8df79f06cc00) 00010000:00010000:2.0:1789127498.147045:0:14771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789127498.147084:0:14771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6200/0xeeacf7c024301b1e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.147112:0:14771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6200/0xeeacf7c024301b1e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.147127:0:14771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6200/0xeeacf7c024301b1e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789127498.147316:0:14771:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000cac854be reply state 000000008acc409a transno 8589934623 ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6200/0xeeacf7c024301b1e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127498.147326:0:14771:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789127498.147417:0:14771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df78efcc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:120b6615-98eb-47cd-be5f-d74b7a580836+14:14730:x1876035733944704:12345-192.168.206.40@tcp:36:lhsmtool_posix.0 Request processed in 503us (758us total) trans 8589934623 rc 0/0 00000100:00100000:2.0:1789127498.147425:0:14771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 59 00010000:00010000:2.0:1789127498.159100:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6200/0xeeacf7c024301b1e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.159116:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6200/0xeeacf7c024301b1e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.159124:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6200/0xeeacf7c024301b1e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.159130:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7aeab6200 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:2.0:1789127498.159134:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6200/0xeeacf7c024301b1e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.159142:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6200/0xeeacf7c024301b1e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.159159:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8df79f06cc00) 00010000:00010000:2.0:1789127498.159176:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789127498.159181:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6200/0xeeacf7c024301b1e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.159188:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6200/0xeeacf7c024301b1e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127498.160937:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127498.161113:0:15457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733944832 00000100:00100000:2.0:1789127498.161123:0:15457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733944832 00000100:00100000:2.0:1789127498.161178:0:15457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 16 00000100:00100000:2.0:1789127498.161189:0:15457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df78efcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:120b6615-98eb-47cd-be5f-d74b7a580836+7:14730:x1876035733944832:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789127498.161208:0:15457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127498.161224:0:15457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000af70175f/0xeeacf7c024301b25 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b802f expref: -99 pid: 15457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.161254:0:15457:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000067de6d11/0xeeacf7c024301b17 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b8028 expref: 8 pid: 15456 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.161264:0:15457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127498.161269:0:15457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127498.161274:0:15457:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af70175f/0xeeacf7c024301b25 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b802f expref: 8 pid: 15457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.161306:0:15457:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000067de6d11/0xeeacf7c024301b17 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b8028 expref: 8 pid: 15456 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.161320:0:15457:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000067de6d11/0xeeacf7c024301b17 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b8028 expref: 8 pid: 15456 timeout: 544 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127498.161354:0:15457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df787b8cf00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:15457:1876035752802048:192.168.206.40@tcp:104: 00000100:00100000:2.0:1789127498.161441:0:15457:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7aea310c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789127498.168317:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127498.168476:0:15457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df787b8cf00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:15457:1876035752802048:192.168.206.40@tcp:104: 00010000:00010000:2.0:1789127498.168505:0:15457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000af70175f/0xeeacf7c024301b25 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b802f expref: 8 pid: 15457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.168524:0:15457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df7aeab7800, rc 0) 00000100:00100000:2.0:1789127498.168577:0:15457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df78efcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:120b6615-98eb-47cd-be5f-d74b7a580836+8:14730:x1876035733944832:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 Request processed in 7389us (7648us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127498.168586:0:15457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 16 00000100:00100000:3.0:1789127498.168658:0:14754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733944960 00000100:00100000:3.0:1789127498.168663:0:14754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733944960 00010000:00010000:3.0:1789127498.168691:0:14754:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000067de6d11/0xeeacf7c024301b17 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b8028 expref: 8 pid: 15456 timeout: 544 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127498.168729:0:14754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 14 00000100:00100000:3.0:1789127498.168737:0:14754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df78efcc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:120b6615-98eb-47cd-be5f-d74b7a580836+8:2349:x1876035733944960:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789127498.168749:0:14754:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127498.168769:0:14754:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000067de6d11/0xeeacf7c024301b17 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b8028 expref: 8 pid: 15456 timeout: 544 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127498.169091:0:14754:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000067de6d11/0xeeacf7c024301b17 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b8028 expref: 8 pid: 15456 timeout: 544 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127498.169115:0:14754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000067de6d11/0xeeacf7c024301b17 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b8028 expref: 8 pid: 15456 timeout: 544 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127498.169128:0:14754:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127498.169143:0:14754:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127498.169150:0:14754:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000af70175f/0xeeacf7c024301b25 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b802f expref: 7 pid: 15457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127498.169160:0:14754:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af70175f/0xeeacf7c024301b25 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b802f expref: 7 pid: 15457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127498.169190:0:14754:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000af70175f/0xeeacf7c024301b25 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b802f expref: 7 pid: 15457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127498.169203:0:14754:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df68265d680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:14754:1876035752802176:192.168.206.40@tcp:105: 00000100:00100000:3.0:1789127498.169250:0:14754:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7aeaaf600 going to sleep for 11 seconds 00000100:00100000:3.0:1789127498.171311:0:14754:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df68265d680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:14754:1876035752802176:192.168.206.40@tcp:105: 00010000:00010000:3.0:1789127498.171332:0:14754:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127498.171384:0:14754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df78efcc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:120b6615-98eb-47cd-be5f-d74b7a580836+7:2349:x1876035733944960:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 2646us (3074us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127498.171395:0:14754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 14 00000100:00100000:1.0:1789127498.172174:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127498.172251:0:15456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733945088 00000100:00100000:2.0:1789127498.172259:0:15456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733945088 00000100:00100000:2.0:1789127498.172297:0:15456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 17 00000100:00100000:2.0:1789127498.172306:0:15456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df78efce1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:120b6615-98eb-47cd-be5f-d74b7a580836+7:2347:x1876035733945088:12345-192.168.206.40@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789127498.172493:0:15456:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1789127498.172497:0:15456:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1789127496 00002000:00010000:2.0:1789127498.172499:0:15456:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1789127495 00002000:00010000:2.0:1789127498.172501:0:15456:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1789127497 -> 1789127496 00002000:00010000:2.0:1789127498.172503:0:15456:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789127498.178112:0:15456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df78efce1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:120b6615-98eb-47cd-be5f-d74b7a580836+8:2347:x1876035733945088:12345-192.168.206.40@tcp:2:lhsmtool_posix.0 Request processed in 5794us (5928us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1789127498.178129:0:15456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 17 00000100:00100000:1.0:1789127498.184091:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127498.184159:0:15457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733945216 00000100:00100000:2.0:1789127498.184181:0:15457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733945216 00000100:00100000:2.0:1789127498.184240:0:15457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 18 00000100:00100000:2.0:1789127498.184250:0:15457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df78efcd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:120b6615-98eb-47cd-be5f-d74b7a580836+8:2349:x1876035733945216:12345-192.168.206.40@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789127498.184295:0:15457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000007964d1f/0xeeacf7c024301b2c lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.184315:0:15457:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000af70175f/0xeeacf7c024301b25 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b802f expref: 8 pid: 15457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.184324:0:15457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127498.184329:0:15457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789127498.184333:0:15457:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000007964d1f/0xeeacf7c024301b2c lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.184443:0:15457:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000af70175f/0xeeacf7c024301b25 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b802f expref: 8 pid: 15457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.184458:0:15457:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000af70175f/0xeeacf7c024301b25 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b802f expref: 8 pid: 15457 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127498.184471:0:15457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df787b8cf00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:15457:1876035752802304:192.168.206.40@tcp:104: 00000100:00100000:2.0:1789127498.184546:0:15457:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7aea310c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789127498.188354:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1789127498.188454:0:14755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733945344 00000100:00100000:0.0:1789127498.188463:0:14755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733945344 00010000:00010000:0.0:1789127498.188500:0:14755:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000af70175f/0xeeacf7c024301b25 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b802f expref: 9 pid: 15457 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127498.188547:0:14755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 15 00000100:00100000:0.0:1789127498.188557:0:14755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df68265d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:120b6615-98eb-47cd-be5f-d74b7a580836+9:2349:x1876035733945344:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789127498.188582:0:14755:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789127498.188606:0:14755:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000af70175f/0xeeacf7c024301b25 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b802f expref: 9 pid: 15457 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127498.188620:0:14755:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000af70175f/0xeeacf7c024301b25 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b802f expref: 9 pid: 15457 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127498.188644:0:14755:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789127498.188647:0:14755:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789127498.188653:0:14755:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000007964d1f/0xeeacf7c024301b2c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127498.188688:0:14755:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000007964d1f/0xeeacf7c024301b2c lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127498.188710:0:14755:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789127498.188769:0:14755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df68265d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:120b6615-98eb-47cd-be5f-d74b7a580836+9:2349:x1876035733945344:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 213us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127498.188777:0:14755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 15 00010000:00010000:2.0:1789127498.191776:0:15457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000af70175f/0xeeacf7c024301b25 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b802f expref: 8 pid: 15457 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127498.191922:0:15457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df787b8cf00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:15457:1876035752802304:192.168.206.40@tcp:104: 00010000:00010000:2.0:1789127498.191964:0:15457:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000007964d1f/0xeeacf7c024301b2c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.191986:0:15457:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000007964d1f/0xeeacf7c024301b2c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.192001:0:15457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000007964d1f/0xeeacf7c024301b2c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.192045:0:15457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000007964d1f/0xeeacf7c024301b2c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.192054:0:15457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000007964d1f/0xeeacf7c024301b2c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.192063:0:15457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000007964d1f/0xeeacf7c024301b2c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.192071:0:15457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7aeab6200 already unused, calling callback (ffffffffc17a4550) 00010000:00010000:2.0:1789127498.192075:0:15457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000007964d1f/0xeeacf7c024301b2c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.192084:0:15457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000007964d1f/0xeeacf7c024301b2c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.192112:0:15457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000007964d1f/0xeeacf7c024301b2c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.192125:0:15457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000007964d1f/0xeeacf7c024301b2c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127498.192844:0:15457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df78efcd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:120b6615-98eb-47cd-be5f-d74b7a580836+7:2349:x1876035733945216:12345-192.168.206.40@tcp:1:lhsmtool_posix.0 Request processed in 8591us (8759us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127498.192855:0:15457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 18 00000100:00100000:1.0:1789127498.195853:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127498.195927:0:14770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733945600 00000100:00100000:3.0:1789127498.195935:0:14770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733945600 00000100:00100000:3.0:1789127498.196146:0:14770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 60 00000100:00100000:3.0:1789127498.196158:0:14770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df78efcd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:120b6615-98eb-47cd-be5f-d74b7a580836+13:14730:x1876035733945600:12345-192.168.206.40@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789127498.196233:0:14770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024301b33 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127498.196251:0:14770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024301b33 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127498.196277:0:14770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024301b33 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127498.196502:0:14770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024301b3a lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127498.196514:0:14770:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c024301b02 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b801a expref: 14 pid: 14770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127498.196523:0:14770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024301b3a lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127498.196555:0:14770:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c024301b02 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b801a expref: 14 pid: 14770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127498.196664:0:14770:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c024301b02 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b801a expref: 14 pid: 14770 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127498.196748:0:14770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df68265e580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14770:1876035752802432:192.168.206.40@tcp:104: 00000100:00100000:3.0:1789127498.196940:0:14770:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7aeaaf480 going to sleep for 11 seconds 00000100:00100000:0.0:1789127498.205861:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127498.205928:0:14754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733945728 00000100:00100000:1.0:1789127498.205937:0:14754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733945728 00010000:00010000:1.0:1789127498.205976:0:14754:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c024301b02 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b801a expref: 15 pid: 14770 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127498.206030:0:14754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 16 00000100:00100000:1.0:1789127498.206041:0:14754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae9792c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:120b6615-98eb-47cd-be5f-d74b7a580836+15:2349:x1876035733945728:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789127498.206056:0:14754:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789127498.206063:0:14754:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c024301b02 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b801a expref: 15 pid: 14770 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127498.206076:0:14754:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c024301b02 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b801a expref: 15 pid: 14770 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127498.206115:0:14754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8df79f06cc00) 00010000:00010000:1.0:1789127498.206120:0:14754:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024301b3a lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127498.206129:0:14754:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024301b3a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127498.206136:0:14754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024301b3a lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127498.206154:0:14754:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789127498.206219:0:14754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae9792c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:120b6615-98eb-47cd-be5f-d74b7a580836+15:2349:x1876035733945728:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 179us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127498.206227:0:14754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 16 00010000:00010000:3.0:1789127498.208925:0:14770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97800/0xeeacf7c024301b02 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b801a expref: 14 pid: 14770 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127498.208947:0:14770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df68265e580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14770:1876035752802432:192.168.206.40@tcp:104: 00010000:00010000:3.0:1789127498.208982:0:14770:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024301b3a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127498.208993:0:14770:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024301b3a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127498.209014:0:14770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024301b3a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789127498.209195:0:14770:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:3.0:1789127498.209342:0:14770:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000001:00080000:3.0:1789127498.209388:0:14770:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934626 00000100:00100000:3.0:1789127498.209467:0:14770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df68265e580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14770:1876035752802560:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789127498.209587:0:14770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127498.209616:0:14770:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df782cb8900 going to sleep for 11 seconds 00000100:00100000:0.0:1789127498.210294:0:14774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752802560 00000100:00100000:0.0:1789127498.210302:0:14774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752802560 00000100:00100000:0.0:1789127498.210352:0:14774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789127498.210361:0:14774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df68265cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14770:x1876035752802560:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789127498.210446:0:14774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df68265cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14770:x1876035752802560:12345-0@lo:1000:mdt00_001.0 Request processed in 86us (858us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127498.210453:0:14774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789127498.210562:0:14770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df68265e580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14770:1876035752802560:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1789127498.211685:0:14770:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000100:00100000:2.0:1789127498.211779:0:14770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df787b8cf00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14770:1876035752802688:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789127498.211919:0:14770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127498.211954:0:14770:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df7aea31840 going to sleep for 11 seconds 00000100:00100000:1.0:1789127498.211999:0:14774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752802688 00000100:00100000:1.0:1789127498.212005:0:14774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752802688 00000100:00100000:1.0:1789127498.212062:0:14774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789127498.212081:0:14774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df787b8f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14770:x1876035752802688:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789127498.212261:0:14774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df787b8f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14770:x1876035752802688:12345-0@lo:1000:mdt00_001.0 Request processed in 190us (341us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1789127498.212269:0:14774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789127498.212408:0:14770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df787b8cf00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14770:1876035752802688:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1789127498.212438:0:14770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024301b3a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127498.212448:0:14770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024301b3a lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127498.212455:0:14770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024301b3a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127498.212461:0:14770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd96a00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:3.0:1789127498.212465:0:14770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024301b3a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127498.212472:0:14770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024301b3a lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127498.212493:0:14770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8df79f06cc00) 00010000:00010000:3.0:1789127498.212496:0:14770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789127498.212509:0:14770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024301b3a lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127498.212515:0:14770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024301b3a lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127498.212552:0:14770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024301a92 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127498.212559:0:14770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024301a92 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127498.212575:0:14770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024301a92 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127498.212581:0:14770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd96000 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:3.0:1789127498.212584:0:14770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024301a92 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127498.212591:0:14770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024301a92 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127498.212598:0:14770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8df79f06c000) 00010000:00010000:3.0:1789127498.212600:0:14770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789127498.212606:0:14770:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96e00/0xeeacf7c024301a99 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7ffe expref: 17 pid: 14771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127498.212618:0:14770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96e00/0xeeacf7c024301a99 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7ffe expref: 17 pid: 14771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127498.212627:0:14770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96e00/0xeeacf7c024301a99 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7ffe expref: 17 pid: 14771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127498.212665:0:14770:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96e00/0xeeacf7c024301a99 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b7ffe expref: 17 pid: 14771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127498.212677:0:14770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df68265e580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14770:1876035752802816:192.168.206.40@tcp:105: 00000100:00100000:3.0:1789127498.212735:0:14770:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df79989acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789127498.217250:0:14770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df68265e580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14770:1876035752802816:192.168.206.40@tcp:105: 00010000:00010000:2.0:1789127498.217283:0:14770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024301a92 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.217295:0:14770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96000/0xeeacf7c024301a92 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.217328:0:14770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7800/0xeeacf7c024301b41 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.217343:0:14770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7800/0xeeacf7c024301b41 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.217354:0:14770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7800/0xeeacf7c024301b41 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.217365:0:14770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7800/0xeeacf7c024301b41 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.217384:0:14770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7800/0xeeacf7c024301b41 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.217390:0:14770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7800/0xeeacf7c024301b41 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.217396:0:14770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7aeab7800 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:2.0:1789127498.217400:0:14770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7800/0xeeacf7c024301b41 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.217409:0:14770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7800/0xeeacf7c024301b41 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.217421:0:14770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8df79f06c000) 00010000:00010000:2.0:1789127498.217425:0:14770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789127498.217429:0:14770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7800/0xeeacf7c024301b41 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.217435:0:14770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7800/0xeeacf7c024301b41 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.217444:0:14770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024301b33 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.217450:0:14770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024301b33 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.217455:0:14770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024301b33 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.217460:0:14770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd97e00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:2.0:1789127498.217469:0:14770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024301b33 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.217475:0:14770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024301b33 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.217487:0:14770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8df79f06c000) 00010000:00010000:2.0:1789127498.217490:0:14770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789127498.217493:0:14770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024301b33 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.217498:0:14770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd97e00/0xeeacf7c024301b33 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127498.217783:0:14770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df78efcd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:120b6615-98eb-47cd-be5f-d74b7a580836+17:14730:x1876035733945600:12345-192.168.206.40@tcp:57:lhsmtool_posix.0 Request processed in 21626us (21998us total) trans 8589934628 rc 0/0 00000100:00100000:2.0:1789127498.217829:0:14770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 60 00000020:00080000:2.0:1789127498.217835:0:14770:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1789127498.218337:0:14801:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789127498.218342:0:14801:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789127498.218432:0:14801:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1789127498.218438:0:14801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1789127498.218941:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127498.219523:0:14773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733945856 00000100:00100000:3.0:1789127498.219532:0:14773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733945856 00000100:00100000:3.0:1789127498.219585:0:14773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 12 00000100:00100000:3.0:1789127498.219594:0:14773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae978000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:120b6615-98eb-47cd-be5f-d74b7a580836+17:14729:x1876035733945856:12345-192.168.206.40@tcp:49:bash.0 00000100:00100000:3.0:1789127498.219709:0:14773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae978000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:120b6615-98eb-47cd-be5f-d74b7a580836+17:14729:x1876035733945856:12345-192.168.206.40@tcp:49:bash.0 Request processed in 116us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127498.219717:0:14773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 12 00000100:00100000:2.0:1789127498.224855:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127498.224946:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127498.225080:0:15456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733946240 00000100:00100000:1.0:1789127498.225091:0:15456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733946240 00000100:00100000:1.0:1789127498.225154:0:15456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 19 00000100:00100000:1.0:1789127498.225165:0:15456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae918780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:120b6615-98eb-47cd-be5f-d74b7a580836+7:14729:x1876035733946240:12345-192.168.206.40@tcp:101:bash.0 00010000:00010000:1.0:1789127498.225184:0:15456:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127498.225204:0:15456:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000068fa612b/0xeeacf7c024301b48 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b8036 expref: -99 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789127498.225259:0:15456:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x6aa3eb48, atime: 0x6aa3eb47, ctime: 0x6aa3eb48, blocks: 0x1 00010000:00010000:1.0:1789127498.225283:0:15456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=444s v=(0 0) 00010000:00010000:1.0:1789127498.225289:0:15456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789127498.225301:0:15456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000068fa612b/0xeeacf7c024301b48 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b8036 expref: 8 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127498.225317:0:15456:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000068fa612b/0xeeacf7c024301b48 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b8036 expref: 8 pid: 15456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127498.225331:0:15456:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df6820ada00, rc 0) 00000100:00100000:1.0:1789127498.225395:0:15456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae918780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:120b6615-98eb-47cd-be5f-d74b7a580836+8:14729:x1876035733946240:12345-192.168.206.40@tcp:101:bash.0 Request processed in 232us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127498.225402:0:15456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 19 00000100:00100000:3.0:1789127498.225529:0:14772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733946112 00000100:00100000:3.0:1789127498.225534:0:14772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733946112 00000100:00100000:3.0:1789127498.225604:0:14772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 13 00000100:00100000:3.0:1789127498.225612:0:14772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df787b8cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:120b6615-98eb-47cd-be5f-d74b7a580836+17:14730:x1876035733946112:12345-192.168.206.40@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789127498.226359:0:14772:0:(mdd_object.c:4024:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789127498.226464:0:14772:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00010000:00010000:3.0:1789127498.226505:0:14772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024301b4f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127498.226520:0:14772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024301b4f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127498.226540:0:14772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024301b4f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127498.226548:0:14772:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024301b4f lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127498.226553:0:14772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024301b4f lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127498.226558:0:14772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024301b4f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127498.226640:0:14772:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789127498.226719:0:14772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df787b8cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:120b6615-98eb-47cd-be5f-d74b7a580836+19:14730:x1876035733946112:12345-192.168.206.40@tcp:35:lhsmtool_posix.0 Request processed in 1107us (1873us total) trans 8589934630 rc 0/0 00000100:00100000:3.0:1789127498.226728:0:14772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 13 00000020:00080000:3.0:1789127498.226733:0:14772:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789127498.227063:0:14757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789127498.227069:0:14757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024301b4f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127498.227077:0:14757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7bbd96a00 already unused, calling callback (ffffffffc17a4550) 00010000:00010000:1.0:1789127498.227081:0:14757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024301b4f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127498.227088:0:14757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024301b4f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127498.227099:0:14757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8df79f06cc00) 00010000:00010000:1.0:1789127498.227102:0:14757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789127498.227115:0:14757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024301b4f lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127498.227120:0:14757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7bbd96a00/0xeeacf7c024301b4f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127498.227132:0:14757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127498.227134:0:14757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127498.227136:0:14757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127498.227743:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127498.227826:0:14773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733946496 00000100:00100000:3.0:1789127498.227833:0:14773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733946496 00000100:00100000:3.0:1789127498.227878:0:14773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 14 00000100:00100000:3.0:1789127498.227887:0:14773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae91a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:120b6615-98eb-47cd-be5f-d74b7a580836+19:14729:x1876035733946496:12345-192.168.206.40@tcp:35:bash.0 00000001:00080000:3.0:1789127498.228106:0:14773:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934631 00000001:00080000:3.0:1789127498.228201:0:14773:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934632 00000100:00100000:3.0:1789127498.228422:0:14773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae91a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:120b6615-98eb-47cd-be5f-d74b7a580836+22:14729:x1876035733946496:12345-192.168.206.40@tcp:35:bash.0 Request processed in 536us (680us total) trans 8589934633 rc 0/0 00000100:00100000:3.0:1789127498.228430:0:14773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 14 00000020:00080000:3.0:1789127498.228434:0:14773:0:(tgt_main.c:785:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1789127498.317090:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127498.317184:0:14769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733946752 00000100:00100000:1.0:1789127498.317192:0:14769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733946752 00000100:00100000:1.0:1789127498.317252:0:14769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 61 00000100:00100000:1.0:1789127498.317261:0:14769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae9783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:120b6615-98eb-47cd-be5f-d74b7a580836+22:14741:x1876035733946752:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:1.0:1789127498.317286:0:14769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127498.317307:0:14769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df6820ac000/0xeeacf7c024301b56 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86aabb40f49b803d expref: -99 pid: 14769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789127498.317516:0:14769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1789127498.317658:0:14769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df6820ac000/0xeeacf7c024301b56 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b803d expref: 24 pid: 14769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127498.317673:0:14769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df782a68300) 00010000:00010000:1.0:1789127498.317676:0:14769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789127498.317681:0:14769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df6820ac000/0xeeacf7c024301b56 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.40@tcp remote: 0x86aabb40f49b803d expref: 24 pid: 14769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127498.317693:0:14769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df6820ac000, rc 0) 00000100:00100000:1.0:1789127498.318203:0:14769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae9783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:120b6615-98eb-47cd-be5f-d74b7a580836+23:14741:x1876035733946752:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 940us (1117us total) trans 8589934634 rc 301/301 00000100:00100000:1.0:1789127498.318222:0:14769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 61 00000100:00100000:0.0:1789127498.324757:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1789127498.325221:0:15986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733946880 00000100:00100000:2.0:1789127498.325231:0:15986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733946880 00000100:00100000:2.0:1789127498.325300:0:15986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 62 00000100:00100000:2.0:1789127498.325310:0:15986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae97ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:120b6615-98eb-47cd-be5f-d74b7a580836+23:14741:x1876035733946880:12345-192.168.206.40@tcp:34:lfs.0 00010000:00010000:2.0:1789127498.325379:0:15986:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6a00/0xeeacf7c024301b64 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.325395:0:15986:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6a00/0xeeacf7c024301b64 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.325425:0:15986:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6a00/0xeeacf7c024301b64 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.325837:0:15986:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6000/0xeeacf7c024301b6b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.325846:0:15986:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6000/0xeeacf7c024301b6b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.325854:0:15986:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6000/0xeeacf7c024301b6b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.326278:0:15986:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7c00/0xeeacf7c024301b72 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.326287:0:15986:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7c00/0xeeacf7c024301b72 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.326294:0:15986:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7c00/0xeeacf7c024301b72 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789127498.326623:0:15986:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7c00/0xeeacf7c024301b72 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.326636:0:15986:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6a00/0xeeacf7c024301b64 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.326642:0:15986:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6a00/0xeeacf7c024301b64 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.326649:0:15986:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6a00/0xeeacf7c024301b64 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.326667:0:15986:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7aeab6a00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:2.0:1789127498.326676:0:15986:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6a00/0xeeacf7c024301b64 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.326684:0:15986:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6a00/0xeeacf7c024301b64 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.326695:0:15986:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8df7906f6d00) 00010000:00010000:2.0:1789127498.326698:0:15986:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789127498.326702:0:15986:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6a00/0xeeacf7c024301b64 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.326708:0:15986:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6a00/0xeeacf7c024301b64 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.326721:0:15986:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6000/0xeeacf7c024301b6b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.326727:0:15986:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6000/0xeeacf7c024301b6b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.326734:0:15986:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6000/0xeeacf7c024301b6b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.326740:0:15986:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7aeab6000 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:2.0:1789127498.326743:0:15986:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6000/0xeeacf7c024301b6b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.326749:0:15986:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6000/0xeeacf7c024301b6b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.326766:0:15986:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8df7906f6b00) 00010000:00010000:2.0:1789127498.326768:0:15986:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789127498.326771:0:15986:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6000/0xeeacf7c024301b6b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.326776:0:15986:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab6000/0xeeacf7c024301b6b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.326831:0:15986:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7c00/0xeeacf7c024301b72 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.326838:0:15986:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7c00/0xeeacf7c024301b72 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.326843:0:15986:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7c00/0xeeacf7c024301b72 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.326849:0:15986:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df7aeab7c00 already unused, calling callback (ffffffffc21c54f0) 00010000:00010000:2.0:1789127498.326851:0:15986:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7c00/0xeeacf7c024301b72 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.326857:0:15986:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7c00/0xeeacf7c024301b72 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.326865:0:15986:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8df79f06c000) 00010000:00010000:2.0:1789127498.326867:0:15986:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789127498.326870:0:15986:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7c00/0xeeacf7c024301b72 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127498.326876:0:15986:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df7aeab7c00/0xeeacf7c024301b72 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127498.326972:0:15986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae97ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:120b6615-98eb-47cd-be5f-d74b7a580836+23:14741:x1876035733946880:12345-192.168.206.40@tcp:34:lfs.0 Request processed in 1661us (2220us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127498.326981:0:15986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 62 00000100:00100000:2.0:1789127498.329657:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127498.329738:0:14772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733947136 00000100:00100000:3.0:1789127498.329967:0:14772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733947136 00000100:00100000:3.0:1789127498.330105:0:14772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 15 00000100:00100000:3.0:1789127498.330115:0:14772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7ae918000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:120b6615-98eb-47cd-be5f-d74b7a580836+23:14741:x1876035733947136:12345-192.168.206.40@tcp:35:lfs.0 00000100:00100000:3.0:1789127498.330497:0:14772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7ae918000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:120b6615-98eb-47cd-be5f-d74b7a580836+24:14741:x1876035733947136:12345-192.168.206.40@tcp:35:lfs.0 Request processed in 383us (848us total) trans 8589934635 rc 0/0 00000100:00100000:3.0:1789127498.330505:0:14772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 15 00010000:00010000:3.0:1789127498.486143:0:16036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127498.987735:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127498.987783:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127498.987856:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127498.987890:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1789127498.987926:0:15457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733947776 00000100:00100000:1.0:1789127498.987936:0:15457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733947776 00000100:00100000:3.0:1789127498.987941:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1789127498.987988:0:15456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733947392 00000100:00100000:3.0:1789127498.987993:0:15456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733947392 00000100:00100000:1.0:1789127498.987996:0:15457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733947648 00000100:00100000:1.0:1789127498.988001:0:15457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733947648 00000100:00100000:1.0:1789127498.988037:0:15457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 18 00000100:00100000:1.0:1789127498.988048:0:15457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df68265e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a6d4506c-e796-46af-9a51-8e6246e70f67+5:2346:x1876035733947776:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:2.0:1789127498.988087:0:14771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733947520 00000100:00100000:2.0:1789127498.988093:0:14771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733947520 00000100:00100000:1.0:1789127498.988131:0:15457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df68265e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a6d4506c-e796-46af-9a51-8e6246e70f67+5:2346:x1876035733947776:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 84us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127498.988138:0:14769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 30 00000100:00100000:2.0:1789127498.988154:0:14769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df68265f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a6d4506c-e796-46af-9a51-8e6246e70f67+6:2346:x1876035733947520:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:2.0:1789127498.988191:0:14769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df68265f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a6d4506c-e796-46af-9a51-8e6246e70f67+6:2346:x1876035733947520:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 44us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127498.988198:0:14769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 30 00000100:00100000:3.0:1789127498.988513:0:15456:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1789127498.988521:0:15456:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1789127498.988712:0:15456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 19 00000100:00100000:3.0:1789127498.988721:0:15456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df68265f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a6d4506c-e796-46af-9a51-8e6246e70f67+5:2346:x1876035733947648:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:3.0:1789127498.988762:0:15456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df68265f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a6d4506c-e796-46af-9a51-8e6246e70f67+5:2346:x1876035733947648:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 42us (823us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127498.988768:0:15456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 19 00000100:00100000:3.0:1789127498.988782:0:15456:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1789127498.988812:0:15456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 20 00000100:00100000:3.0:1789127498.988819:0:15456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df68265da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:120b6615-98eb-47cd-be5f-d74b7a580836+5:2346:x1876035733947392:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:3.0:1789127498.988846:0:15456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df68265da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:120b6615-98eb-47cd-be5f-d74b7a580836+5:2346:x1876035733947392:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 29us (956us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127498.988865:0:15456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 20 00000100:00100000:0.0:1789127498.991857:0:14764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035733947264 00000100:00100000:0.0:1789127498.991871:0:14764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035733947264 00000100:00100000:0.0:1789127498.991932:0:14764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 122 00000100:00100000:0.0:1789127498.991942:0:14764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7af252c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24264358-ed5d-48f3-a95a-0a1ee90442a0+13:2346:x1876035733947264:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:0.0:1789127498.992029:0:14764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7af252c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24264358-ed5d-48f3-a95a-0a1ee90442a0+13:2346:x1876035733947264:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 77us (4291us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127498.992038:0:14764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 122 00000100:00080000:0.0:1789127498.992222:0:14765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789127498.992229:0:14765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789127498.992232:0:14765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789127498.992865:0:15457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 18 00010000:00010000:2.0:1789127499.507575:0:14758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789127499.849982:0:17041:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: /mnt/lustre/d1c.sanity-pcc/f1c.sanity-pcc expected pcc state: readwrite, but got: none 00010000:00010000:1.0:1789127500.531059:0:14757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127500.789494:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789127500.789517:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df7ae97b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1876035752802944:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789127500.789584:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127500.789693:0:15459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752802944 00000100:00100000:0.0:1789127500.789701:0:15459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752802944 00000100:00100000:0.0:1789127500.789761:0:15459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789127500.789771:0:15459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df78efcde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1876035752802944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789127500.789835:0:15459:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789127500.789889:0:15459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df78efcde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1876035752802944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127500.789897:0:15459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1789127500.790252:0:14765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789127500.790287:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df7ae97b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1876035752802944:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789127500.794231:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df68265f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1876035752803456:0@lo:400:kworker.0 00000100:00100000:3.0:1789127500.794296:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127500.794333:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789127500.794340:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df68265c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:396611f1-c34a-4e5a-8396-03624226b0e0:3302:1876035752803072:0@lo:400:kworker.0 00000100:00100000:3.0:1789127500.794369:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127500.794394:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df68265de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1876035752803584:0@lo:400:kworker.0 00000100:00100000:3.0:1789127500.794421:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127500.794443:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df68265ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876035752803328:0@lo:400:kworker.0 00000100:00100000:3.0:1789127500.794467:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127500.794482:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789127500.794486:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df68265e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1876035752803200:0@lo:400:kworker.0 00000100:00100000:3.0:1789127500.794509:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127500.794536:0:14770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752803456 00000100:00100000:3.0:1789127500.794542:0:14770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752803456 00000100:00100000:3.0:1789127500.794587:0:14770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752803584 00000100:00100000:3.0:1789127500.794591:0:14770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752803584 00000100:00100000:3.0:1789127500.794604:0:14770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752803328 00000100:00100000:3.0:1789127500.794606:0:14770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752803328 00000100:00100000:3.0:1789127500.794620:0:14770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789127500.794628:0:14770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df68265e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876035752803456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127500.794677:0:14770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df68265e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876035752803456:12345-0@lo:400:kworker.0 Request processed in 50us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127500.794684:0:14770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789127500.794718:0:14770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789127500.794725:0:14770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df68265c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876035752803584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127500.794754:0:14770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df68265c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876035752803584:12345-0@lo:400:kworker.0 Request processed in 30us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127500.794760:0:14770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789127500.794773:0:14770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789127500.794779:0:14770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6820bc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876035752803328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127500.794841:0:14770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6820bc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876035752803328:12345-0@lo:400:kworker.0 Request processed in 61us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127500.794847:0:14770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789127500.794880:0:15456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752803200 00000100:00100000:3.0:1789127500.794883:0:15456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752803200 00000100:00100000:3.0:1789127500.794909:0:15456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789127500.794917:0:15456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df682e730c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1876035752803200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127500.795072:0:15456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df682e730c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1876035752803200:12345-0@lo:400:kworker.0 Request processed in 156us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127500.795079:0:15456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789127500.795114:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df68265e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1876035752803200:0@lo:400:kworker.0 00000100:00100000:3.0:1789127500.795125:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df68265ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876035752803328:0@lo:400:kworker.0 00000100:00100000:3.0:1789127500.795156:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df68265de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1876035752803584:0@lo:400:kworker.0 00000100:00100000:3.0:1789127500.795165:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df68265f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1876035752803456:0@lo:400:kworker.0 00000100:00100000:0.0:1789127500.795249:0:14761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035752803072 00000100:00100000:0.0:1789127500.795254:0:14761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035752803072 00000100:00100000:0.0:1789127500.795282:0:14761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1789127500.795289:0:14761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df7af252850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:396611f1-c34a-4e5a-8396-03624226b0e0+19:3302:x1876035752803072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127500.795329:0:14761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df7af252850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:396611f1-c34a-4e5a-8396-03624226b0e0+19:3302:x1876035752803072:12345-0@lo:400:kworker.0 Request processed in 41us (960us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127500.795336:0:14761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1789127500.795390:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df68265c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:396611f1-c34a-4e5a-8396-03624226b0e0:3302:1876035752803072:0@lo:400:kworker.0 00000100:00080000:1.0:1789127500.795620:0:14765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789127500.795625:0:14765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:2.0:1789127501.411755:0:7646:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000001:00080000:2.0:1789127501.411805:0:7646:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00000001:00080000:2.0:1789127501.411826:0:7646:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934596 is committed 00010000:00010000:0.0:1789127501.555910:0:16036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 30335 lines, 30335 kept, 0 dropped, 0 bad.